2026-02-13T01:15:42.111 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T01:15:42.133 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:15:42.217 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/kernel_untar_build}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47429' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - disabled max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded mgr-modules: - snap_schedule sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 781/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 2a169eb9e607483c93b70d215a0ade702b8a648f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB6myIthv1OZq61Ws51VM3m2Q4r21u4KSQp9JePz1ONZHpspfwuXUmgWbNrJz2KUUDu/jhTMOncAphuH8LM6X2E= trial126.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFxiyYAhKAJvgqmlDdH+Xh84mDPTaH3BxC9pF4bMz7PjKIZzWuA2VmilbLVMIz8V7D6mtepVHrh+RpGbPE95pIQ= trial154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAlMLa74fAjLZ5VGA3u7quDAnjpz1C5AjXphcaTMc5VX56DVQiA3S5CeuVhWHX0smiKvYtY3qLhNv2l9Uf0sIA= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - kernel_untar_build.sh timeout: 5h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:09:17 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T01:15:42.217 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa; will attempt to use it 2026-02-13T01:15:42.217 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks 2026-02-13T01:15:42.218 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T01:15:42.219 INFO:teuthology.task.internal:Checking packages... 2026-02-13T01:15:42.219 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T01:15:42.219 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T01:15:42.219 INFO:teuthology.packaging:ref: None 2026-02-13T01:15:42.219 INFO:teuthology.packaging:tag: None 2026-02-13T01:15:42.219 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T01:15:42.219 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:15:42.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T01:15:42.334 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T01:15:42.335 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T01:15:42.347 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T01:15:42.347 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T01:15:42.361 INFO:teuthology.task.internal:Saving configuration 2026-02-13T01:15:42.380 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T01:15:42.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T01:15:42.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial091.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:16.789864', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB6myIthv1OZq61Ws51VM3m2Q4r21u4KSQp9JePz1ONZHpspfwuXUmgWbNrJz2KUUDu/jhTMOncAphuH8LM6X2E='} 2026-02-13T01:15:42.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial126.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:16.790847', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFxiyYAhKAJvgqmlDdH+Xh84mDPTaH3BxC9pF4bMz7PjKIZzWuA2VmilbLVMIz8V7D6mtepVHrh+RpGbPE95pIQ='} 2026-02-13T01:15:42.578 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial154.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 01:10:16.790443', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEAlMLa74fAjLZ5VGA3u7quDAnjpz1C5AjXphcaTMc5VX56DVQiA3S5CeuVhWHX0smiKvYtY3qLhNv2l9Uf0sIA='} 2026-02-13T01:15:42.578 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T01:15:42.593 INFO:teuthology.task.internal:roles: ubuntu@trial091.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T01:15:42.593 INFO:teuthology.task.internal:roles: ubuntu@trial126.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T01:15:42.593 INFO:teuthology.task.internal:roles: ubuntu@trial154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T01:15:42.593 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T01:15:42.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x772160dee160>, signals=[15]) 2026-02-13T01:15:42.815 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T01:15:42.826 INFO:teuthology.task.internal:Opening connections... 2026-02-13T01:15:42.826 DEBUG:teuthology.task.internal:connecting to ubuntu@trial091.front.sepia.ceph.com 2026-02-13T01:15:42.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:42.896 DEBUG:teuthology.task.internal:connecting to ubuntu@trial126.front.sepia.ceph.com 2026-02-13T01:15:42.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:42.957 DEBUG:teuthology.task.internal:connecting to ubuntu@trial154.front.sepia.ceph.com 2026-02-13T01:15:42.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:15:43.018 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T01:15:43.030 DEBUG:teuthology.orchestra.run.trial091:> uname -m 2026-02-13T01:15:43.047 INFO:teuthology.orchestra.run.trial091.stdout:x86_64 2026-02-13T01:15:43.048 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:NAME="CentOS Stream" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="9" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:ID="centos" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="9" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;31" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:15:43.106 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:15:43.107 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server 2026-02-13T01:15:43.234 DEBUG:teuthology.orchestra.run.trial126:> uname -m 2026-02-13T01:15:43.249 INFO:teuthology.orchestra.run.trial126.stdout:x86_64 2026-02-13T01:15:43.249 DEBUG:teuthology.orchestra.run.trial126:> cat /etc/os-release 2026-02-13T01:15:43.305 INFO:teuthology.orchestra.run.trial126.stdout:NAME="CentOS Stream" 2026-02-13T01:15:43.305 INFO:teuthology.orchestra.run.trial126.stdout:VERSION="9" 2026-02-13T01:15:43.305 INFO:teuthology.orchestra.run.trial126.stdout:ID="centos" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:VERSION_ID="9" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:ANSI_COLOR="0;31" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:15:43.306 INFO:teuthology.orchestra.run.trial126.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:15:43.307 INFO:teuthology.orchestra.run.trial126.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:15:43.307 INFO:teuthology.lock.ops:Updating trial126.front.sepia.ceph.com on lock server 2026-02-13T01:15:43.406 DEBUG:teuthology.orchestra.run.trial154:> uname -m 2026-02-13T01:15:43.423 INFO:teuthology.orchestra.run.trial154.stdout:x86_64 2026-02-13T01:15:43.424 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T01:15:43.480 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T01:15:43.481 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server 2026-02-13T01:15:43.539 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T01:15:43.552 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T01:15:43.562 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T01:15:43.562 DEBUG:teuthology.orchestra.run.trial091:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:15:43.564 DEBUG:teuthology.orchestra.run.trial126:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:15:43.566 DEBUG:teuthology.orchestra.run.trial154:> test '!' -e /home/ubuntu/cephtest 2026-02-13T01:15:43.582 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T01:15:43.593 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T01:15:43.594 DEBUG:teuthology.orchestra.run.trial091:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:15:43.621 DEBUG:teuthology.orchestra.run.trial126:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:15:43.623 DEBUG:teuthology.orchestra.run.trial154:> test -z $(ls -A /var/lib/ceph) 2026-02-13T01:15:43.639 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T01:15:43.848 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T01:15:43.867 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-13T01:15:43.867 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}, 'mon.c': {'sha1': 'distro'}}, timeout 300 2026-02-13T01:15:43.867 DEBUG:teuthology.orchestra.run.trial091:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:15:43.868 DEBUG:teuthology.orchestra.run.trial126:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:15:43.868 DEBUG:teuthology.orchestra.run.trial154:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T01:15:43.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:15:43.883 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-13T01:15:43.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:15:43.884 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-13T01:15:43.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:15:43.885 DEBUG:teuthology.orchestra.run.trial091:> uname -r 2026-02-13T01:15:43.938 INFO:teuthology.orchestra.run.trial126.stdout:5.14.0-645.el9.x86_64 2026-02-13T01:15:43.938 INFO:teuthology.task.kernel:Running kernel on trial126: 5.14.0-645.el9.x86_64 2026-02-13T01:15:43.938 DEBUG:teuthology.orchestra.run.trial126:> sudo yum install -y kernel 2026-02-13T01:15:43.939 INFO:teuthology.orchestra.run.trial154.stdout:5.14.0-645.el9.x86_64 2026-02-13T01:15:43.939 INFO:teuthology.task.kernel:Running kernel on trial154: 5.14.0-645.el9.x86_64 2026-02-13T01:15:43.940 DEBUG:teuthology.orchestra.run.trial154:> sudo yum install -y kernel 2026-02-13T01:15:43.940 INFO:teuthology.orchestra.run.trial091.stdout:5.14.0-645.el9.x86_64 2026-02-13T01:15:43.940 INFO:teuthology.task.kernel:Running kernel on trial091: 5.14.0-645.el9.x86_64 2026-02-13T01:15:43.940 DEBUG:teuthology.orchestra.run.trial091:> sudo yum install -y kernel 2026-02-13T01:15:44.783 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.9 MB 00:00 2026-02-13T01:15:45.004 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T01:15:45.385 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.9 MB 00:01 2026-02-13T01:15:47.629 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-13T01:15:48.100 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-13T01:15:51.566 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-13T01:15:52.680 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - AppStream 4.0 MB/s | 27 MB 00:06 2026-02-13T01:15:52.783 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 20 kB 00:00 2026-02-13T01:15:53.588 INFO:teuthology.orchestra.run.trial126.stdout:Extra Packages for Enterprise Linux 28 MB/s | 20 MB 00:00 2026-02-13T01:15:55.389 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 7.8 MB 00:05 2026-02-13T01:15:56.035 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 7.8 MB 00:00 2026-02-13T01:15:56.816 INFO:teuthology.orchestra.run.trial126.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T01:15:57.252 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-13T01:15:57.854 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-13T01:15:57.870 INFO:teuthology.orchestra.run.trial126.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T01:15:57.890 INFO:teuthology.orchestra.run.trial126.stdout:Dependencies resolved. 2026-02-13T01:15:57.891 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout: Package Architecture Version Repository Size 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout:Installing: 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout:Installing dependencies: 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T01:15:57.892 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout:Transaction Summary 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout:Install 4 Packages 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout:Total download size: 88 M 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout:Installed size: 135 M 2026-02-13T01:15:57.893 INFO:teuthology.orchestra.run.trial126.stdout:Downloading Packages: 2026-02-13T01:15:58.012 INFO:teuthology.orchestra.run.trial126.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 12 MB/s | 768 kB 00:00 2026-02-13T01:15:58.135 INFO:teuthology.orchestra.run.trial126.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 93 MB/s | 17 MB 00:00 2026-02-13T01:15:58.222 INFO:teuthology.orchestra.run.trial126.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 147 MB/s | 31 MB 00:00 2026-02-13T01:15:58.227 INFO:teuthology.orchestra.run.trial154.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-13T01:15:58.319 INFO:teuthology.orchestra.run.trial126.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 108 MB/s | 40 MB 00:00 2026-02-13T01:15:58.319 INFO:teuthology.orchestra.run.trial126.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:15:58.319 INFO:teuthology.orchestra.run.trial126.stdout:Total 206 MB/s | 88 MB 00:00 2026-02-13T01:15:58.445 INFO:teuthology.orchestra.run.trial091.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-13T01:15:58.510 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction check 2026-02-13T01:15:58.713 INFO:teuthology.orchestra.run.trial126.stdout:Transaction check succeeded. 2026-02-13T01:15:58.713 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction test 2026-02-13T01:15:59.060 INFO:teuthology.orchestra.run.trial126.stdout:Transaction test succeeded. 2026-02-13T01:15:59.060 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction 2026-02-13T01:16:00.148 INFO:teuthology.orchestra.run.trial126.stdout: Preparing : 1/1 2026-02-13T01:16:00.432 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T01:16:00.451 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:01.445 INFO:teuthology.orchestra.run.trial154.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-13T01:16:01.712 INFO:teuthology.orchestra.run.trial091.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T01:16:02.229 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:02.258 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:02.512 INFO:teuthology.orchestra.run.trial154.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T01:16:02.532 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T01:16:02.533 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:16:02.534 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-13T01:16:02.535 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T01:16:02.535 INFO:teuthology.orchestra.run.trial154.stdout:Install 4 Packages 2026-02-13T01:16:02.535 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:16:02.535 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 88 M 2026-02-13T01:16:02.535 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 135 M 2026-02-13T01:16:02.535 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-13T01:16:02.779 INFO:teuthology.orchestra.run.trial091.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-13T01:16:02.799 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-13T01:16:02.800 INFO:teuthology.orchestra.run.trial091.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout:Install 4 Packages 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 88 M 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 135 M 2026-02-13T01:16:02.801 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-13T01:16:03.043 INFO:teuthology.orchestra.run.trial154.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 3.7 MB/s | 768 kB 00:00 2026-02-13T01:16:03.638 INFO:teuthology.orchestra.run.trial154.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 21 MB/s | 17 MB 00:00 2026-02-13T01:16:04.163 INFO:teuthology.orchestra.run.trial091.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 603 kB/s | 768 kB 00:01 2026-02-13T01:16:04.409 INFO:teuthology.orchestra.run.trial154.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 25 MB/s | 40 MB 00:01 2026-02-13T01:16:04.625 INFO:teuthology.orchestra.run.trial154.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 19 MB/s | 31 MB 00:01 2026-02-13T01:16:04.625 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:16:04.626 INFO:teuthology.orchestra.run.trial154.stdout:Total 42 MB/s | 88 MB 00:02 2026-02-13T01:16:04.817 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-13T01:16:05.024 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-13T01:16:05.025 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-13T01:16:05.287 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:05.294 INFO:teuthology.orchestra.run.trial126.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:05.371 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-13T01:16:05.371 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-13T01:16:06.465 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-13T01:16:06.750 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T01:16:06.769 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:08.326 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:08.526 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:08.555 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:11.643 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:11.649 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:14.743 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:22.927 INFO:teuthology.orchestra.run.trial091.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 871 kB/s | 17 MB 00:20 2026-02-13T01:16:38.438 INFO:teuthology.orchestra.run.trial091.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 920 kB/s | 31 MB 00:34 2026-02-13T01:16:38.722 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:38.742 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:38.912 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:38.912 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T01:16:38.912 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:38.912 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout:Installed: 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:16:38.964 INFO:teuthology.orchestra.run.trial126.stdout:Complete! 2026-02-13T01:16:39.023 DEBUG:teuthology.orchestra.run.trial126:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T01:16:39.049 INFO:teuthology.orchestra.run.trial126.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T01:16:39.051 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T01:16:39.051 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T01:16:39.051 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T01:16:39.051 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T01:16:39.051 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T01:16:39.052 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial126.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T01:16:39.052 DEBUG:teuthology.orchestra.run.trial126:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T01:16:39.114 INFO:teuthology.orchestra.run.trial126.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T01:16:39.114 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T01:16:39.114 DEBUG:teuthology.orchestra.run.trial126:> sudo rpm -qi grub2-tools 2026-02-13T01:16:39.183 INFO:teuthology.orchestra.run.trial126.stdout:Name : grub2-tools 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Epoch : 1 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Version : 2.06 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Release : 118.el9 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Architecture: x86_64 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Group : Unspecified 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:Size : 8393909 2026-02-13T01:16:39.184 INFO:teuthology.orchestra.run.trial126.stdout:License : GPLv3+ 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Packager : builder@centos.org 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Vendor : CentOS 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Summary : Support tools for GRUB. 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:Description : 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:16:39.185 INFO:teuthology.orchestra.run.trial126.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T01:16:39.186 INFO:teuthology.orchestra.run.trial126.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T01:16:39.186 INFO:teuthology.orchestra.run.trial126.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T01:16:39.186 INFO:teuthology.orchestra.run.trial126.stdout:hardware devices. 2026-02-13T01:16:39.186 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:16:39.186 INFO:teuthology.orchestra.run.trial126.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T01:16:39.187 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T01:16:39.187 INFO:teuthology.task.kernel:Updating grub on trial126 to boot 5.14.0-677.el9.x86_64 2026-02-13T01:16:39.188 DEBUG:teuthology.orchestra.run.trial126:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T01:16:39.250 INFO:teuthology.orchestra.run.trial126.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T01:16:39.251 DEBUG:teuthology.orchestra.run.trial126:> sudo command -v grubby && echo yes || echo no 2026-02-13T01:16:39.314 INFO:teuthology.orchestra.run.trial126.stdout:/sbin/grubby 2026-02-13T01:16:39.315 INFO:teuthology.orchestra.run.trial126.stdout:yes 2026-02-13T01:16:39.315 DEBUG:teuthology.orchestra.run.trial126:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T01:16:39.380 INFO:teuthology.orchestra.run.trial126.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T01:16:39.381 DEBUG:teuthology.orchestra.run.trial126:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T01:16:39.457 DEBUG:teuthology.orchestra.run.trial126:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T01:16:39.663 INFO:teuthology.orchestra.run.trial126.stderr:Generating grub configuration file ... 2026-02-13T01:16:39.726 INFO:teuthology.orchestra.run.trial126.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T01:16:39.733 INFO:teuthology.orchestra.run.trial126.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T01:16:39.977 INFO:teuthology.orchestra.run.trial126.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T01:16:39.984 INFO:teuthology.orchestra.run.trial126.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T01:16:40.015 INFO:teuthology.orchestra.run.trial126.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T01:16:40.021 INFO:teuthology.orchestra.run.trial126.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T01:16:40.044 INFO:teuthology.orchestra.run.trial126.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T01:16:40.051 INFO:teuthology.orchestra.run.trial126.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T01:16:40.131 INFO:teuthology.orchestra.run.trial126.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T01:16:40.140 INFO:teuthology.orchestra.run.trial126.stderr:done 2026-02-13T01:16:40.142 DEBUG:teuthology.orchestra.run.trial126:> test -d /sys/firmware/efi 2026-02-13T01:16:40.158 DEBUG:teuthology.orchestra.run.trial126:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T01:16:40.223 INFO:teuthology.orchestra.run.trial126.stdout:/boot/efi/EFI/BOOT 2026-02-13T01:16:40.224 INFO:teuthology.orchestra.run.trial126.stdout:/boot/efi/EFI/centos 2026-02-13T01:16:40.225 DEBUG:teuthology.orchestra.run.trial126:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T01:16:40.291 INFO:teuthology.orchestra.run.trial126.stdout:no 2026-02-13T01:16:40.292 DEBUG:teuthology.orchestra.run.trial126:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T01:16:40.356 INFO:teuthology.orchestra.run.trial126.stdout:yes 2026-02-13T01:16:40.356 DEBUG:teuthology.orchestra.run.trial126:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T01:16:40.420 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial126 2026-02-13T01:16:40.420 DEBUG:teuthology.orchestra.run.trial126:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T01:16:45.259 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:45.281 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:45.451 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:45.452 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T01:16:45.452 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:45.452 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:45.503 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:16:45.504 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T01:16:45.563 DEBUG:teuthology.orchestra.run.trial154:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T01:16:45.589 INFO:teuthology.orchestra.run.trial154.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.590 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T01:16:45.590 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T01:16:45.590 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T01:16:45.590 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T01:16:45.591 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-13T01:16:45.591 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial154.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T01:16:45.591 DEBUG:teuthology.orchestra.run.trial154:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T01:16:45.653 INFO:teuthology.orchestra.run.trial154.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T01:16:45.655 DEBUG:teuthology.orchestra.run.trial154:> sudo rpm -qi grub2-tools 2026-02-13T01:16:45.723 INFO:teuthology.orchestra.run.trial154.stdout:Name : grub2-tools 2026-02-13T01:16:45.723 INFO:teuthology.orchestra.run.trial154.stdout:Epoch : 1 2026-02-13T01:16:45.723 INFO:teuthology.orchestra.run.trial154.stdout:Version : 2.06 2026-02-13T01:16:45.723 INFO:teuthology.orchestra.run.trial154.stdout:Release : 118.el9 2026-02-13T01:16:45.723 INFO:teuthology.orchestra.run.trial154.stdout:Architecture: x86_64 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Group : Unspecified 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Size : 8393909 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:License : GPLv3+ 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Packager : builder@centos.org 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Vendor : CentOS 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T01:16:45.724 INFO:teuthology.orchestra.run.trial154.stdout:Summary : Support tools for GRUB. 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout:Description : 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout:hardware devices. 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:16:45.725 INFO:teuthology.orchestra.run.trial154.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T01:16:45.726 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T01:16:45.726 INFO:teuthology.task.kernel:Updating grub on trial154 to boot 5.14.0-677.el9.x86_64 2026-02-13T01:16:45.727 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T01:16:45.790 INFO:teuthology.orchestra.run.trial154.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T01:16:45.792 DEBUG:teuthology.orchestra.run.trial154:> sudo command -v grubby && echo yes || echo no 2026-02-13T01:16:45.857 INFO:teuthology.orchestra.run.trial154.stdout:/sbin/grubby 2026-02-13T01:16:45.858 INFO:teuthology.orchestra.run.trial154.stdout:yes 2026-02-13T01:16:45.859 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T01:16:45.925 INFO:teuthology.orchestra.run.trial154.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T01:16:45.925 DEBUG:teuthology.orchestra.run.trial154:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T01:16:45.999 DEBUG:teuthology.orchestra.run.trial154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T01:16:46.208 INFO:teuthology.orchestra.run.trial154.stderr:Generating grub configuration file ... 2026-02-13T01:16:46.271 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T01:16:46.277 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T01:16:46.527 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T01:16:46.533 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T01:16:46.564 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T01:16:46.571 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T01:16:46.594 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T01:16:46.601 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T01:16:46.683 INFO:teuthology.orchestra.run.trial154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T01:16:46.691 INFO:teuthology.orchestra.run.trial154.stderr:done 2026-02-13T01:16:46.693 DEBUG:teuthology.orchestra.run.trial154:> test -d /sys/firmware/efi 2026-02-13T01:16:46.709 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T01:16:46.775 INFO:teuthology.orchestra.run.trial154.stdout:/boot/efi/EFI/BOOT 2026-02-13T01:16:46.775 INFO:teuthology.orchestra.run.trial154.stdout:/boot/efi/EFI/centos 2026-02-13T01:16:46.777 DEBUG:teuthology.orchestra.run.trial154:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T01:16:46.842 INFO:teuthology.orchestra.run.trial154.stdout:no 2026-02-13T01:16:46.843 DEBUG:teuthology.orchestra.run.trial154:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T01:16:46.908 INFO:teuthology.orchestra.run.trial154.stdout:yes 2026-02-13T01:16:46.909 DEBUG:teuthology.orchestra.run.trial154:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T01:16:46.973 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial154 2026-02-13T01:16:46.973 DEBUG:teuthology.orchestra.run.trial154:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T01:16:48.226 INFO:teuthology.orchestra.run.trial091.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 894 kB/s | 40 MB 00:45 2026-02-13T01:16:48.228 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:16:48.228 INFO:teuthology.orchestra.run.trial091.stdout:Total 1.9 MB/s | 88 MB 00:45 2026-02-13T01:16:48.418 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-13T01:16:48.618 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-13T01:16:48.618 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-13T01:16:48.963 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-13T01:16:48.964 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-13T01:16:50.054 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-13T01:16:50.338 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-13T01:16:50.357 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:52.117 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:16:52.145 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:55.378 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:16:55.384 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:16:58.418 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:17:10.463 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T01:17:10.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-13T01:17:10.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:17:17.015 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-13T01:17:17.015 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T01:17:17.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:17:28.710 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:17:28.730 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:17:28.901 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:17:28.901 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-13T01:17:28.901 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-13T01:17:28.901 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-13T01:17:28.953 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:17:28.954 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T01:17:29.012 DEBUG:teuthology.orchestra.run.trial091:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T01:17:29.037 INFO:teuthology.orchestra.run.trial091.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T01:17:29.038 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T01:17:29.038 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-13T01:17:29.038 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T01:17:29.038 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T01:17:29.038 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T01:17:29.038 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial091.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T01:17:29.039 DEBUG:teuthology.orchestra.run.trial091:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T01:17:29.102 INFO:teuthology.orchestra.run.trial091.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-13T01:17:29.103 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-13T01:17:29.103 DEBUG:teuthology.orchestra.run.trial091:> sudo rpm -qi grub2-tools 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Name : grub2-tools 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Epoch : 1 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Version : 2.06 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Release : 118.el9 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Architecture: x86_64 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Group : Unspecified 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Size : 8393909 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:License : GPLv3+ 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Packager : builder@centos.org 2026-02-13T01:17:29.171 INFO:teuthology.orchestra.run.trial091.stdout:Vendor : CentOS 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:Summary : Support tools for GRUB. 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:Description : 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:hardware devices. 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:17:29.172 INFO:teuthology.orchestra.run.trial091.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T01:17:29.172 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T01:17:29.172 INFO:teuthology.task.kernel:Updating grub on trial091 to boot 5.14.0-677.el9.x86_64 2026-02-13T01:17:29.173 DEBUG:teuthology.orchestra.run.trial091:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T01:17:29.236 INFO:teuthology.orchestra.run.trial091.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T01:17:29.237 DEBUG:teuthology.orchestra.run.trial091:> sudo command -v grubby && echo yes || echo no 2026-02-13T01:17:29.300 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/grubby 2026-02-13T01:17:29.302 INFO:teuthology.orchestra.run.trial091.stdout:yes 2026-02-13T01:17:29.302 DEBUG:teuthology.orchestra.run.trial091:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-13T01:17:29.368 INFO:teuthology.orchestra.run.trial091.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-13T01:17:29.369 DEBUG:teuthology.orchestra.run.trial091:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-13T01:17:29.440 DEBUG:teuthology.orchestra.run.trial091:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T01:17:29.652 INFO:teuthology.orchestra.run.trial091.stderr:Generating grub configuration file ... 2026-02-13T01:17:29.714 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-13T01:17:29.720 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-13T01:17:29.975 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T01:17:29.981 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T01:17:30.012 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T01:17:30.019 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T01:17:30.042 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T01:17:30.049 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T01:17:30.131 INFO:teuthology.orchestra.run.trial091.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T01:17:30.139 INFO:teuthology.orchestra.run.trial091.stderr:done 2026-02-13T01:17:30.142 DEBUG:teuthology.orchestra.run.trial091:> test -d /sys/firmware/efi 2026-02-13T01:17:30.157 DEBUG:teuthology.orchestra.run.trial091:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T01:17:30.223 INFO:teuthology.orchestra.run.trial091.stdout:/boot/efi/EFI/BOOT 2026-02-13T01:17:30.223 INFO:teuthology.orchestra.run.trial091.stdout:/boot/efi/EFI/centos 2026-02-13T01:17:30.225 DEBUG:teuthology.orchestra.run.trial091:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T01:17:30.290 INFO:teuthology.orchestra.run.trial091.stdout:no 2026-02-13T01:17:30.291 DEBUG:teuthology.orchestra.run.trial091:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T01:17:30.354 INFO:teuthology.orchestra.run.trial091.stdout:yes 2026-02-13T01:17:30.355 DEBUG:teuthology.orchestra.run.trial091:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T01:17:30.420 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial091 2026-02-13T01:17:30.420 DEBUG:teuthology.orchestra.run.trial091:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T01:18:00.463 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T01:18:00.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T01:18:00.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:18:10.476 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T01:18:17.024 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T01:18:19.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-13T01:18:19.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:18:19.564 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-13T01:18:19.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-13T01:18:19.710 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-13T01:18:19.710 DEBUG:teuthology.orchestra.run.trial126:> uname -r 2026-02-13T01:18:19.766 INFO:teuthology.orchestra.run.trial126.stdout:5.14.0-677.el9.x86_64 2026-02-13T01:18:19.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T01:18:19.766 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T01:18:19.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T01:18:20.766 DEBUG:teuthology.parallel:result is None 2026-02-13T01:18:26.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T01:18:26.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:18:26.131 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-13T01:18:26.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T01:18:26.286 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-13T01:18:26.286 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-13T01:18:26.344 INFO:teuthology.orchestra.run.trial154.stdout:5.14.0-677.el9.x86_64 2026-02-13T01:18:26.344 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T01:18:26.344 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T01:18:26.344 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T01:18:27.345 DEBUG:teuthology.parallel:result is None 2026-02-13T01:19:00.465 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T01:19:09.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T01:19:09.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:19:09.604 DEBUG:teuthology.orchestra.run.trial091:> true 2026-02-13T01:19:09.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T01:19:09.757 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-13T01:19:09.757 DEBUG:teuthology.orchestra.run.trial091:> uname -r 2026-02-13T01:19:09.813 INFO:teuthology.orchestra.run.trial091.stdout:5.14.0-677.el9.x86_64 2026-02-13T01:19:09.814 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-13T01:19:09.814 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T01:19:09.814 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T01:19:10.815 DEBUG:teuthology.parallel:result is None 2026-02-13T01:19:10.815 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T01:19:10.826 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T01:19:10.826 DEBUG:teuthology.orchestra.run.trial091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:19:10.829 DEBUG:teuthology.orchestra.run.trial126:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:19:10.832 DEBUG:teuthology.orchestra.run.trial154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T01:19:10.852 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T01:19:10.863 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T01:19:10.878 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T01:19:10.878 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:19:10.887 DEBUG:teuthology.orchestra.run.trial126:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:19:10.889 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T01:19:10.920 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T01:19:10.932 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T01:19:10.932 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:19:10.943 DEBUG:teuthology.orchestra.run.trial126:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:19:10.946 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T01:19:10.969 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:10.974 INFO:teuthology.orchestra.run.trial126.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:10.977 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:10.981 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:10.983 INFO:teuthology.orchestra.run.trial126.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:10.990 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T01:19:10.992 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T01:19:11.004 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T01:19:11.004 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:19:11.022 DEBUG:teuthology.orchestra.run.trial126:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:19:11.026 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T01:19:11.058 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T01:19:11.079 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T01:19:11.080 DEBUG:teuthology.orchestra.run.trial091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:19:11.087 DEBUG:teuthology.orchestra.run.trial126:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:19:11.090 DEBUG:teuthology.orchestra.run.trial154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T01:19:11.113 DEBUG:teuthology.orchestra.run.trial091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:11.234 DEBUG:teuthology.orchestra.run.trial091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:11.259 DEBUG:teuthology.orchestra.run.trial091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:11.400 DEBUG:teuthology.orchestra.run.trial091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:11.424 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:19:11.424 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:19:11.490 DEBUG:teuthology.orchestra.run.trial126:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:11.589 DEBUG:teuthology.orchestra.run.trial126:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:11.614 DEBUG:teuthology.orchestra.run.trial126:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:11.753 DEBUG:teuthology.orchestra.run.trial126:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:11.778 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:19:11.778 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:19:11.841 DEBUG:teuthology.orchestra.run.trial154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:11.920 DEBUG:teuthology.orchestra.run.trial154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:19:11.944 DEBUG:teuthology.orchestra.run.trial154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:12.070 DEBUG:teuthology.orchestra.run.trial154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:19:12.096 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:19:12.096 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T01:19:12.158 DEBUG:teuthology.orchestra.run.trial091:> sudo service rsyslog restart 2026-02-13T01:19:12.160 DEBUG:teuthology.orchestra.run.trial126:> sudo service rsyslog restart 2026-02-13T01:19:12.162 DEBUG:teuthology.orchestra.run.trial154:> sudo service rsyslog restart 2026-02-13T01:19:12.186 INFO:teuthology.orchestra.run.trial091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:19:12.188 INFO:teuthology.orchestra.run.trial126.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:19:12.226 INFO:teuthology.orchestra.run.trial154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:19:12.742 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T01:19:12.753 INFO:teuthology.task.internal:Starting timer... 2026-02-13T01:19:12.753 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T01:19:12.772 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T01:19:12.785 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T01:19:12.785 DEBUG:teuthology.orchestra.run.trial091:> sudo service auditd rotate 2026-02-13T01:19:12.813 INFO:teuthology.orchestra.run.trial091.stdout:Rotating logs: 2026-02-13T01:19:12.815 DEBUG:teuthology.orchestra.run.trial126:> sudo service auditd rotate 2026-02-13T01:19:12.844 INFO:teuthology.orchestra.run.trial126.stdout:Rotating logs: 2026-02-13T01:19:12.846 DEBUG:teuthology.orchestra.run.trial154:> sudo service auditd rotate 2026-02-13T01:19:12.875 INFO:teuthology.orchestra.run.trial154.stdout:Rotating logs: 2026-02-13T01:19:12.876 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T01:19:12.877 DEBUG:teuthology.orchestra.run.trial091:> /usr/sbin/getenforce 2026-02-13T01:19:12.893 INFO:teuthology.orchestra.run.trial091.stdout:Permissive 2026-02-13T01:19:12.893 DEBUG:teuthology.orchestra.run.trial126:> /usr/sbin/getenforce 2026-02-13T01:19:12.910 INFO:teuthology.orchestra.run.trial126.stdout:Permissive 2026-02-13T01:19:12.910 DEBUG:teuthology.orchestra.run.trial154:> /usr/sbin/getenforce 2026-02-13T01:19:12.932 INFO:teuthology.orchestra.run.trial154.stdout:Permissive 2026-02-13T01:19:12.932 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial091.front.sepia.ceph.com': 'permissive', 'ubuntu@trial126.front.sepia.ceph.com': 'permissive', 'ubuntu@trial154.front.sepia.ceph.com': 'permissive'} 2026-02-13T01:19:12.932 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:19:12.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:12.958 DEBUG:teuthology.orchestra.run.trial126:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:19:12.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:12.984 DEBUG:teuthology.orchestra.run.trial154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:19:13.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:19:13.010 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T01:19:13.011 DEBUG:teuthology.orchestra.run.trial091:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:19:13.036 DEBUG:teuthology.orchestra.run.trial126:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:19:13.059 DEBUG:teuthology.orchestra.run.trial154:> sudo /usr/sbin/setenforce permissive 2026-02-13T01:19:13.083 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T01:19:13.095 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T01:19:13.103 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T01:19:13.104 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial091.front.sepia.ceph.com,trial126.front.sepia.ceph.com,trial154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T01:20:42.644 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial091.front.sepia.ceph.com'), Remote(name='ubuntu@trial126.front.sepia.ceph.com'), Remote(name='ubuntu@trial154.front.sepia.ceph.com')] 2026-02-13T01:20:42.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T01:20:42.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:20:42.757 DEBUG:teuthology.orchestra.run.trial091:> true 2026-02-13T01:20:42.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T01:20:42.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-13T01:20:42.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:20:42.932 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-13T01:20:43.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-13T01:20:43.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T01:20:43.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T01:20:43.106 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-13T01:20:43.182 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-13T01:20:43.182 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T01:20:43.196 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T01:20:43.196 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:20:43.197 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:20:43.199 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:20:43.199 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:20:43.202 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T01:20:43.202 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:20:43.225 INFO:teuthology.orchestra.run.trial091.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:20:43.229 INFO:teuthology.orchestra.run.trial126.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:20:43.238 INFO:teuthology.orchestra.run.trial091.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:20:43.240 INFO:teuthology.orchestra.run.trial126.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:20:43.250 INFO:teuthology.orchestra.run.trial154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T01:20:43.259 INFO:teuthology.orchestra.run.trial091.stderr:sudo: ntpd: command not found 2026-02-13T01:20:43.259 INFO:teuthology.orchestra.run.trial126.stderr:sudo: ntpd: command not found 2026-02-13T01:20:43.261 INFO:teuthology.orchestra.run.trial154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T01:20:43.268 INFO:teuthology.orchestra.run.trial091.stdout:506 Cannot talk to daemon 2026-02-13T01:20:43.268 INFO:teuthology.orchestra.run.trial126.stdout:506 Cannot talk to daemon 2026-02-13T01:20:43.280 INFO:teuthology.orchestra.run.trial091.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:20:43.280 INFO:teuthology.orchestra.run.trial126.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:20:43.281 INFO:teuthology.orchestra.run.trial154.stderr:sudo: ntpd: command not found 2026-02-13T01:20:43.290 INFO:teuthology.orchestra.run.trial154.stdout:506 Cannot talk to daemon 2026-02-13T01:20:43.291 INFO:teuthology.orchestra.run.trial091.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:20:43.292 INFO:teuthology.orchestra.run.trial126.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:20:43.301 INFO:teuthology.orchestra.run.trial154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T01:20:43.313 INFO:teuthology.orchestra.run.trial154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T01:20:43.339 INFO:teuthology.orchestra.run.trial091.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:20:43.340 INFO:teuthology.orchestra.run.trial126.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:20:43.341 INFO:teuthology.orchestra.run.trial091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:20:43.341 INFO:teuthology.orchestra.run.trial091.stdout:=============================================================================== 2026-02-13T01:20:43.341 INFO:teuthology.orchestra.run.trial091.stdout:^? europa.ellipse.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.341 INFO:teuthology.orchestra.run.trial091.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.341 INFO:teuthology.orchestra.run.trial091.stdout:^? ntp.nexcess.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.342 INFO:teuthology.orchestra.run.trial091.stdout:^? 172-104-28-175.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.343 INFO:teuthology.orchestra.run.trial126.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:20:43.343 INFO:teuthology.orchestra.run.trial126.stdout:=============================================================================== 2026-02-13T01:20:43.343 INFO:teuthology.orchestra.run.trial126.stdout:^? 23.186.168.133 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.343 INFO:teuthology.orchestra.run.trial126.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.343 INFO:teuthology.orchestra.run.trial126.stdout:^? 107-172-222-7-host.coloc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.344 INFO:teuthology.orchestra.run.trial126.stdout:^? 99-28-14-242.lightspeed.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.354 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:20:43.366 INFO:teuthology.orchestra.run.trial154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:20:43.366 INFO:teuthology.orchestra.run.trial154.stdout:=============================================================================== 2026-02-13T01:20:43.367 INFO:teuthology.orchestra.run.trial154.stdout:^? 149.28.61.105.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.367 INFO:teuthology.orchestra.run.trial154.stdout:^? 108.61.73.243 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.367 INFO:teuthology.orchestra.run.trial154.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.367 INFO:teuthology.orchestra.run.trial154.stdout:^? jane.mattnordhoffdns.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T01:20:43.368 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T01:20:43.385 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T01:20:43.386 DEBUG:teuthology.orchestra.run.trial091:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:20:43.386 DEBUG:teuthology.orchestra.run.trial126:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:20:43.387 DEBUG:teuthology.orchestra.run.trial154:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T01:20:43.390 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial126.front.sepia.ceph.com 2026-02-13T01:20:43.390 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:20:43.390 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:20:43.391 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial091.front.sepia.ceph.com 2026-02-13T01:20:43.391 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:20:43.391 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:20:43.410 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial154.front.sepia.ceph.com 2026-02-13T01:20:43.411 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T01:20:43.411 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T01:20:43.564 INFO:teuthology.orchestra.run.trial126.stdout:No match for argument: nvme-cli 2026-02-13T01:20:43.565 INFO:teuthology.orchestra.run.trial126.stderr:No packages marked for removal. 2026-02-13T01:20:43.565 INFO:teuthology.orchestra.run.trial091.stdout:No match for argument: nvme-cli 2026-02-13T01:20:43.566 INFO:teuthology.orchestra.run.trial091.stderr:No packages marked for removal. 2026-02-13T01:20:43.567 INFO:teuthology.orchestra.run.trial126.stdout:Dependencies resolved. 2026-02-13T01:20:43.567 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T01:20:43.567 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-13T01:20:43.567 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T01:20:43.568 INFO:teuthology.orchestra.run.trial126.stdout:Nothing to do. 2026-02-13T01:20:43.568 INFO:teuthology.orchestra.run.trial126.stdout:Complete! 2026-02-13T01:20:43.582 INFO:teuthology.orchestra.run.trial154.stdout:No match for argument: nvme-cli 2026-02-13T01:20:43.583 INFO:teuthology.orchestra.run.trial154.stderr:No packages marked for removal. 2026-02-13T01:20:43.585 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T01:20:43.585 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-13T01:20:43.586 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T01:20:43.865 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Feb 2026 01:19:55 AM UTC. 2026-02-13T01:20:43.866 INFO:teuthology.orchestra.run.trial126.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Feb 2026 01:19:54 AM UTC. 2026-02-13T01:20:43.883 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Feb 2026 01:19:54 AM UTC. 2026-02-13T01:20:43.946 INFO:teuthology.orchestra.run.trial126.stdout:Dependencies resolved. 2026-02-13T01:20:43.947 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-13T01:20:43.947 INFO:teuthology.orchestra.run.trial126.stdout: Package Architecture Version Repository Size 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout:Installing: 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout:Upgrading: 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout:Installing dependencies: 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:20:43.948 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout:Transaction Summary 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout:================================================================================ 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout:Install 6 Packages 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout:Upgrade 1 Package 2026-02-13T01:20:43.949 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:20:43.950 INFO:teuthology.orchestra.run.trial126.stdout:Total download size: 2.4 M 2026-02-13T01:20:43.950 INFO:teuthology.orchestra.run.trial126.stdout:Downloading Packages: 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout:Upgrading: 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:20:43.951 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout:Install 6 Packages 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout:Upgrade 1 Package 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 2.4 M 2026-02-13T01:20:43.952 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-13T01:20:43.964 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T01:20:43.965 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T01:20:43.965 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-13T01:20:43.965 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T01:20:43.965 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout:Upgrading: 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-13T01:20:43.966 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-13T01:20:43.967 INFO:teuthology.orchestra.run.trial154.stdout:Install 6 Packages 2026-02-13T01:20:43.967 INFO:teuthology.orchestra.run.trial154.stdout:Upgrade 1 Package 2026-02-13T01:20:43.967 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:20:43.967 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 2.4 M 2026-02-13T01:20:43.967 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-13T01:20:44.039 INFO:teuthology.orchestra.run.trial154.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 3.1 MB/s | 44 kB 00:00 2026-02-13T01:20:44.039 INFO:teuthology.orchestra.run.trial154.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 4.9 MB/s | 72 kB 00:00 2026-02-13T01:20:44.047 INFO:teuthology.orchestra.run.trial154.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 10 MB/s | 84 kB 00:00 2026-02-13T01:20:44.048 INFO:teuthology.orchestra.run.trial154.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 16 MB/s | 150 kB 00:00 2026-02-13T01:20:44.053 INFO:teuthology.orchestra.run.trial154.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-13T01:20:44.054 INFO:teuthology.orchestra.run.trial154.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 19 MB/s | 116 kB 00:00 2026-02-13T01:20:44.061 INFO:teuthology.orchestra.run.trial154.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 58 MB/s | 837 kB 00:00 2026-02-13T01:20:44.062 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:44.062 INFO:teuthology.orchestra.run.trial154.stdout:Total 25 MB/s | 2.4 MB 00:00 2026-02-13T01:20:44.117 INFO:teuthology.orchestra.run.trial091.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 563 kB/s | 44 kB 00:00 2026-02-13T01:20:44.125 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-13T01:20:44.130 INFO:teuthology.orchestra.run.trial091.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 793 kB/s | 72 kB 00:00 2026-02-13T01:20:44.133 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-13T01:20:44.133 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-13T01:20:44.168 INFO:teuthology.orchestra.run.trial091.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.6 MB/s | 84 kB 00:00 2026-02-13T01:20:44.176 INFO:teuthology.orchestra.run.trial091.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 3.2 MB/s | 150 kB 00:00 2026-02-13T01:20:44.192 INFO:teuthology.orchestra.run.trial091.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 7.5 MB/s | 1.2 MB 00:00 2026-02-13T01:20:44.195 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-13T01:20:44.195 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-13T01:20:44.201 INFO:teuthology.orchestra.run.trial091.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 4.6 MB/s | 116 kB 00:00 2026-02-13T01:20:44.234 INFO:teuthology.orchestra.run.trial091.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 12 MB/s | 837 kB 00:00 2026-02-13T01:20:44.234 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:44.234 INFO:teuthology.orchestra.run.trial091.stdout:Total 8.5 MB/s | 2.4 MB 00:00 2026-02-13T01:20:44.265 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-13T01:20:44.298 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-13T01:20:44.305 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-13T01:20:44.305 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-13T01:20:44.332 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:20:44.339 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:20:44.341 INFO:teuthology.orchestra.run.trial126.stdout:[MIRROR] nvme-cli-2.16-1.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/nvme-cli-2.16-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-13T01:20:44.348 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:20:44.349 INFO:teuthology.orchestra.run.trial126.stdout:[MIRROR] python3-configshell-1.1.30-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/python3-configshell-1.1.30-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-13T01:20:44.354 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:20:44.360 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:20:44.361 INFO:teuthology.orchestra.run.trial154.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:44.366 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-13T01:20:44.366 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-13T01:20:44.435 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-13T01:20:44.489 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:44.492 INFO:teuthology.orchestra.run.trial154.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:44.502 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:20:44.508 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:20:44.517 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:20:44.523 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:20:44.528 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:20:44.529 INFO:teuthology.orchestra.run.trial091.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:44.655 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:44.657 INFO:teuthology.orchestra.run.trial091.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:44.760 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:44.760 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:20:44.760 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:20:44.784 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:44.801 INFO:teuthology.orchestra.run.trial126.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 55 kB/s | 44 kB 00:00 2026-02-13T01:20:44.846 INFO:teuthology.orchestra.run.trial126.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 86 kB/s | 72 kB 00:00 2026-02-13T01:20:44.934 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:44.934 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:20:44.934 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:20:44.957 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:44.970 INFO:teuthology.orchestra.run.trial126.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 500 kB/s | 84 kB 00:00 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:20:45.005 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:20:45.058 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout:Upgraded: 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:20:45.059 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T01:20:45.089 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:20:45.175 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout:Upgraded: 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:20:45.228 INFO:teuthology.orchestra.run.trial091.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:20:45.229 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:20:45.229 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:20:45.229 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T01:20:45.258 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:45.401 INFO:teuthology.orchestra.run.trial126.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 271 kB/s | 150 kB 00:00 2026-02-13T01:20:45.722 INFO:teuthology.orchestra.run.trial126.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 363 kB/s | 116 kB 00:00 2026-02-13T01:20:46.002 INFO:teuthology.orchestra.run.trial126.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 812 kB/s | 837 kB 00:01 2026-02-13T01:20:46.099 INFO:teuthology.orchestra.run.trial126.stdout:(7/7): nvme-cli-2.16-1.el9.x86_64.rpm 565 kB/s | 1.2 MB 00:02 2026-02-13T01:20:46.101 INFO:teuthology.orchestra.run.trial126.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:20:46.101 INFO:teuthology.orchestra.run.trial126.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-13T01:20:46.169 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction check 2026-02-13T01:20:46.178 INFO:teuthology.orchestra.run.trial126.stdout:Transaction check succeeded. 2026-02-13T01:20:46.178 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction test 2026-02-13T01:20:46.243 INFO:teuthology.orchestra.run.trial126.stdout:Transaction test succeeded. 2026-02-13T01:20:46.243 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction 2026-02-13T01:20:46.313 INFO:teuthology.orchestra.run.trial126.stdout: Preparing : 1/1 2026-02-13T01:20:46.380 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T01:20:46.387 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T01:20:46.396 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T01:20:46.402 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T01:20:46.407 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T01:20:46.408 INFO:teuthology.orchestra.run.trial126.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:46.537 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T01:20:46.540 INFO:teuthology.orchestra.run.trial126.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:46.816 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T01:20:46.816 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T01:20:46.816 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:20:46.839 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T01:20:47.052 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T01:20:47.053 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T01:20:47.110 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T01:20:47.110 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout:Upgraded: 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout:Installed: 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:20:47.111 INFO:teuthology.orchestra.run.trial126.stdout:Complete! 2026-02-13T01:20:47.141 DEBUG:teuthology.parallel:result is None 2026-02-13T01:20:47.142 INFO:teuthology.run_tasks:Running task install... 2026-02-13T01:20:47.157 DEBUG:teuthology.task.install:project ceph 2026-02-13T01:20:47.157 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T01:20:47.157 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T01:20:47.157 INFO:teuthology.task.install:Using flavor: default 2026-02-13T01:20:47.166 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T01:20:47.166 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T01:20:47.167 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:20:47.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:47.170 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:20:47.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:47.172 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T01:20:47.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:20:47.408 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:20:47.409 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:20:47.411 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:20:47.411 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:20:47.419 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T01:20:47.419 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T01:20:47.595 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:20:47.595 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:20:47.595 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:20:47.607 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:20:47.607 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:20:47.607 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:20:47.621 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T01:20:47.621 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:20:47.621 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T01:20:47.625 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:20:47.625 DEBUG:teuthology.orchestra.run.trial126:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:20:47.635 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:20:47.635 DEBUG:teuthology.orchestra.run.trial154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:20:47.650 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T01:20:47.650 DEBUG:teuthology.orchestra.run.trial091:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T01:20:47.691 DEBUG:teuthology.orchestra.run.trial126:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:20:47.700 DEBUG:teuthology.orchestra.run.trial154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:20:47.714 DEBUG:teuthology.orchestra.run.trial091:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T01:20:47.765 DEBUG:teuthology.orchestra.run.trial126:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:20:47.772 DEBUG:teuthology.orchestra.run.trial154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:20:47.788 DEBUG:teuthology.orchestra.run.trial091:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T01:20:47.829 INFO:teuthology.orchestra.run.trial126.stdout:check_obsoletes = 1 2026-02-13T01:20:47.831 DEBUG:teuthology.orchestra.run.trial126:> sudo yum clean all 2026-02-13T01:20:47.836 INFO:teuthology.orchestra.run.trial154.stdout:check_obsoletes = 1 2026-02-13T01:20:47.837 DEBUG:teuthology.orchestra.run.trial154:> sudo yum clean all 2026-02-13T01:20:47.852 INFO:teuthology.orchestra.run.trial091.stdout:check_obsoletes = 1 2026-02-13T01:20:47.853 DEBUG:teuthology.orchestra.run.trial091:> sudo yum clean all 2026-02-13T01:20:47.979 INFO:teuthology.orchestra.run.trial126.stdout:41 files removed 2026-02-13T01:20:47.988 INFO:teuthology.orchestra.run.trial154.stdout:41 files removed 2026-02-13T01:20:47.993 DEBUG:teuthology.orchestra.run.trial126:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:20:48.002 INFO:teuthology.orchestra.run.trial091.stdout:41 files removed 2026-02-13T01:20:48.003 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:20:48.016 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T01:20:48.266 INFO:teuthology.orchestra.run.trial126.stdout:ceph packages for x86_64 731 kB/s | 91 kB 00:00 2026-02-13T01:20:48.289 INFO:teuthology.orchestra.run.trial154.stdout:ceph packages for x86_64 657 kB/s | 91 kB 00:00 2026-02-13T01:20:48.296 INFO:teuthology.orchestra.run.trial091.stdout:ceph packages for x86_64 677 kB/s | 91 kB 00:00 2026-02-13T01:20:48.413 INFO:teuthology.orchestra.run.trial126.stdout:ceph noarch packages 194 kB/s | 23 kB 00:00 2026-02-13T01:20:48.437 INFO:teuthology.orchestra.run.trial154.stdout:ceph noarch packages 191 kB/s | 23 kB 00:00 2026-02-13T01:20:48.448 INFO:teuthology.orchestra.run.trial091.stdout:ceph noarch packages 188 kB/s | 23 kB 00:00 2026-02-13T01:20:48.540 INFO:teuthology.orchestra.run.trial126.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T01:20:48.569 INFO:teuthology.orchestra.run.trial154.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-13T01:20:48.572 INFO:teuthology.orchestra.run.trial091.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T01:20:49.180 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.9 MB 00:00 2026-02-13T01:20:49.258 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-13T01:20:52.735 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 27 MB 00:03 2026-02-13T01:20:52.842 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 27 MB 00:03 2026-02-13T01:20:53.889 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.9 MB 00:05 2026-02-13T01:20:55.030 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - AppStream 45 MB/s | 27 MB 00:00 2026-02-13T01:20:56.199 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 7.8 MB 00:00 2026-02-13T01:20:56.724 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 7.8 MB 00:01 2026-02-13T01:20:57.631 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - Extras packages 114 kB/s | 20 kB 00:00 2026-02-13T01:20:58.583 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 7.8 MB 00:01 2026-02-13T01:20:58.625 INFO:teuthology.orchestra.run.trial091.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2026-02-13T01:20:58.998 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - Extras packages 9.7 kB/s | 20 kB 00:02 2026-02-13T01:20:59.642 INFO:teuthology.orchestra.run.trial126.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-13T01:20:59.756 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 20 kB 00:00 2026-02-13T01:21:01.913 INFO:teuthology.orchestra.run.trial091.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-13T01:21:02.320 INFO:teuthology.orchestra.run.trial154.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 20 MB 00:02 2026-02-13T01:21:02.831 INFO:teuthology.orchestra.run.trial126.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-13T01:21:03.192 INFO:teuthology.orchestra.run.trial091.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:03.193 INFO:teuthology.orchestra.run.trial091.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:03.198 INFO:teuthology.orchestra.run.trial091.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:21:03.199 INFO:teuthology.orchestra.run.trial091.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:21:03.199 INFO:teuthology.orchestra.run.trial091.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:21:03.199 INFO:teuthology.orchestra.run.trial091.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:21:03.200 INFO:teuthology.orchestra.run.trial091.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:21:03.201 INFO:teuthology.orchestra.run.trial091.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:21:03.202 INFO:teuthology.orchestra.run.trial091.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:21:03.229 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repository Size 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:21:03.234 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:21:03.235 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:21:03.236 INFO:teuthology.orchestra.run.trial091.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout:Upgrading: 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:21:03.237 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:21:03.238 INFO:teuthology.orchestra.run.trial091.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:21:03.239 INFO:teuthology.orchestra.run.trial091.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:21:03.240 INFO:teuthology.orchestra.run.trial091.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:21:03.241 INFO:teuthology.orchestra.run.trial091.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:21:03.242 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:21:03.243 INFO:teuthology.orchestra.run.trial091.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:21:03.244 INFO:teuthology.orchestra.run.trial091.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:21:03.245 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:21:03.246 INFO:teuthology.orchestra.run.trial091.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:21:03.247 INFO:teuthology.orchestra.run.trial091.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout:Installing weak dependencies: 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout:Install 162 Packages 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout:Upgrade 11 Packages 2026-02-13T01:21:03.248 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:21:03.249 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 302 M 2026-02-13T01:21:03.249 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-13T01:21:04.029 INFO:teuthology.orchestra.run.trial091.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2026-02-13T01:21:04.117 INFO:teuthology.orchestra.run.trial126.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:04.118 INFO:teuthology.orchestra.run.trial126.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:04.123 INFO:teuthology.orchestra.run.trial126.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:21:04.124 INFO:teuthology.orchestra.run.trial126.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:21:04.124 INFO:teuthology.orchestra.run.trial126.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:21:04.124 INFO:teuthology.orchestra.run.trial126.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:21:04.125 INFO:teuthology.orchestra.run.trial126.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:21:04.127 INFO:teuthology.orchestra.run.trial126.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:21:04.127 INFO:teuthology.orchestra.run.trial126.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:21:04.154 INFO:teuthology.orchestra.run.trial126.stdout:Dependencies resolved. 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout:======================================================================================= 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: Package Arch Version Repository Size 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout:======================================================================================= 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout:Installing: 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:21:04.159 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout:Upgrading: 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:21:04.160 INFO:teuthology.orchestra.run.trial126.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout:Installing dependencies: 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:21:04.161 INFO:teuthology.orchestra.run.trial126.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:21:04.162 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:21:04.163 INFO:teuthology.orchestra.run.trial126.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:Installing weak dependencies: 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:Transaction Summary 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:======================================================================================= 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:Install 162 Packages 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:Upgrade 11 Packages 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:Total download size: 302 M 2026-02-13T01:21:04.164 INFO:teuthology.orchestra.run.trial126.stdout:Downloading Packages: 2026-02-13T01:21:04.897 INFO:teuthology.orchestra.run.trial091.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.1 MB/s | 987 kB 00:00 2026-02-13T01:21:05.028 INFO:teuthology.orchestra.run.trial091.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 1.1 MB/s | 147 kB 00:00 2026-02-13T01:21:05.070 INFO:teuthology.orchestra.run.trial126.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 24 kB/s | 6.5 kB 00:00 2026-02-13T01:21:05.504 INFO:teuthology.orchestra.run.trial154.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-13T01:21:06.002 INFO:teuthology.orchestra.run.trial126.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.0 MB/s | 987 kB 00:00 2026-02-13T01:21:06.130 INFO:teuthology.orchestra.run.trial126.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 1.1 MB/s | 147 kB 00:00 2026-02-13T01:21:06.497 INFO:teuthology.orchestra.run.trial091.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 1.6 MB/s | 2.4 MB 00:01 2026-02-13T01:21:06.543 INFO:teuthology.orchestra.run.trial091.stdout:(5/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 1.9 MB/s | 5.2 MB 00:02 2026-02-13T01:21:06.774 INFO:teuthology.orchestra.run.trial154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:06.775 INFO:teuthology.orchestra.run.trial154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T01:21:06.780 INFO:teuthology.orchestra.run.trial154.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T01:21:06.781 INFO:teuthology.orchestra.run.trial154.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T01:21:06.781 INFO:teuthology.orchestra.run.trial154.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T01:21:06.782 INFO:teuthology.orchestra.run.trial154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T01:21:06.783 INFO:teuthology.orchestra.run.trial154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T01:21:06.784 INFO:teuthology.orchestra.run.trial154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T01:21:06.784 INFO:teuthology.orchestra.run.trial154.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T01:21:06.812 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-13T01:21:06.816 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repository Size 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T01:21:06.817 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T01:21:06.818 INFO:teuthology.orchestra.run.trial154.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T01:21:06.819 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout:Upgrading: 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T01:21:06.820 INFO:teuthology.orchestra.run.trial154.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T01:21:06.821 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T01:21:06.822 INFO:teuthology.orchestra.run.trial154.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T01:21:06.823 INFO:teuthology.orchestra.run.trial154.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T01:21:06.824 INFO:teuthology.orchestra.run.trial154.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T01:21:06.825 INFO:teuthology.orchestra.run.trial154.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T01:21:06.826 INFO:teuthology.orchestra.run.trial154.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T01:21:06.827 INFO:teuthology.orchestra.run.trial154.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T01:21:06.828 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T01:21:06.829 INFO:teuthology.orchestra.run.trial154.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T01:21:06.830 INFO:teuthology.orchestra.run.trial154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout:Installing weak dependencies: 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout:Install 162 Packages 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout:Upgrade 11 Packages 2026-02-13T01:21:06.831 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:21:06.832 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 302 M 2026-02-13T01:21:06.832 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-13T01:21:07.021 INFO:teuthology.orchestra.run.trial091.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 1.7 MB/s | 940 kB 00:00 2026-02-13T01:21:07.132 INFO:teuthology.orchestra.run.trial091.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 1.5 MB/s | 166 kB 00:00 2026-02-13T01:21:07.345 INFO:teuthology.orchestra.run.trial126.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.0 MB/s | 5.2 MB 00:02 2026-02-13T01:21:07.683 INFO:teuthology.orchestra.run.trial126.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 2.7 MB/s | 940 kB 00:00 2026-02-13T01:21:07.688 INFO:teuthology.orchestra.run.trial154.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2026-02-13T01:21:07.807 INFO:teuthology.orchestra.run.trial126.stdout:(6/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 1.4 MB/s | 2.4 MB 00:01 2026-02-13T01:21:07.998 INFO:teuthology.orchestra.run.trial126.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 874 kB/s | 166 kB 00:00 2026-02-13T01:21:08.319 INFO:teuthology.orchestra.run.trial154.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.5 MB/s | 987 kB 00:00 2026-02-13T01:21:08.376 INFO:teuthology.orchestra.run.trial154.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 2.6 MB/s | 147 kB 00:00 2026-02-13T01:21:08.580 INFO:teuthology.orchestra.run.trial091.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 2.4 MB/s | 5.0 MB 00:02 2026-02-13T01:21:09.234 INFO:teuthology.orchestra.run.trial154.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 2.8 MB/s | 2.4 MB 00:00 2026-02-13T01:21:09.438 INFO:teuthology.orchestra.run.trial126.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 2.8 MB/s | 5.0 MB 00:01 2026-02-13T01:21:09.555 INFO:teuthology.orchestra.run.trial154.stdout:(5/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.5 MB/s | 5.2 MB 00:02 2026-02-13T01:21:09.611 INFO:teuthology.orchestra.run.trial154.stdout:(6/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 2.4 MB/s | 940 kB 00:00 2026-02-13T01:21:09.725 INFO:teuthology.orchestra.run.trial154.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 1.4 MB/s | 166 kB 00:00 2026-02-13T01:21:11.470 INFO:teuthology.orchestra.run.trial154.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 2.6 MB/s | 5.0 MB 00:01 2026-02-13T01:21:14.792 INFO:teuthology.orchestra.run.trial126.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 2.4 MB/s | 24 MB 00:09 2026-02-13T01:21:15.413 INFO:teuthology.orchestra.run.trial091.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 2.1 MB/s | 24 MB 00:11 2026-02-13T01:21:16.371 INFO:teuthology.orchestra.run.trial091.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 1.7 MB/s | 16 MB 00:09 2026-02-13T01:21:16.438 INFO:teuthology.orchestra.run.trial091.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 377 kB/s | 25 kB 00:00 2026-02-13T01:21:17.619 INFO:teuthology.orchestra.run.trial154.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 2.4 MB/s | 24 MB 00:10 2026-02-13T01:21:18.488 INFO:teuthology.orchestra.run.trial154.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 1.8 MB/s | 16 MB 00:08 2026-02-13T01:21:18.553 INFO:teuthology.orchestra.run.trial154.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 390 kB/s | 25 kB 00:00 2026-02-13T01:21:20.002 INFO:teuthology.orchestra.run.trial126.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 1.8 MB/s | 19 MB 00:10 2026-02-13T01:21:20.071 INFO:teuthology.orchestra.run.trial126.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 362 kB/s | 25 kB 00:00 2026-02-13T01:21:20.789 INFO:teuthology.orchestra.run.trial091.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 1.6 MB/s | 19 MB 00:12 2026-02-13T01:21:20.985 INFO:teuthology.orchestra.run.trial091.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 1.2 MB/s | 243 kB 00:00 2026-02-13T01:21:21.051 INFO:teuthology.orchestra.run.trial091.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 415 kB/s | 27 kB 00:00 2026-02-13T01:21:21.119 INFO:teuthology.orchestra.run.trial091.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 546 kB/s | 37 kB 00:00 2026-02-13T01:21:21.188 INFO:teuthology.orchestra.run.trial091.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 358 kB/s | 24 kB 00:00 2026-02-13T01:21:21.227 INFO:teuthology.orchestra.run.trial126.stdout:(12/173): ceph-osd-classic-20.3.0-5241.g8f8d382 1.2 MB/s | 16 MB 00:13 2026-02-13T01:21:21.372 INFO:teuthology.orchestra.run.trial126.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 1.6 MB/s | 243 kB 00:00 2026-02-13T01:21:21.440 INFO:teuthology.orchestra.run.trial126.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 397 kB/s | 27 kB 00:00 2026-02-13T01:21:21.509 INFO:teuthology.orchestra.run.trial126.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 544 kB/s | 37 kB 00:00 2026-02-13T01:21:21.579 INFO:teuthology.orchestra.run.trial126.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 348 kB/s | 24 kB 00:00 2026-02-13T01:21:21.932 INFO:teuthology.orchestra.run.trial091.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 1.2 MB/s | 909 kB 00:00 2026-02-13T01:21:22.044 INFO:teuthology.orchestra.run.trial126.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 1.9 MB/s | 909 kB 00:00 2026-02-13T01:21:22.129 INFO:teuthology.orchestra.run.trial091.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 807 kB/s | 159 kB 00:00 2026-02-13T01:21:22.177 INFO:teuthology.orchestra.run.trial126.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 1.2 MB/s | 159 kB 00:00 2026-02-13T01:21:22.247 INFO:teuthology.orchestra.run.trial126.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 1.7 MB/s | 123 kB 00:00 2026-02-13T01:21:22.265 INFO:teuthology.orchestra.run.trial091.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 909 kB/s | 123 kB 00:00 2026-02-13T01:21:22.381 INFO:teuthology.orchestra.run.trial126.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 1.8 MB/s | 248 kB 00:00 2026-02-13T01:21:22.536 INFO:teuthology.orchestra.run.trial091.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 915 kB/s | 248 kB 00:00 2026-02-13T01:21:23.085 INFO:teuthology.orchestra.run.trial154.stdout:(12/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 1.6 MB/s | 19 MB 00:11 2026-02-13T01:21:23.216 INFO:teuthology.orchestra.run.trial154.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 1.8 MB/s | 243 kB 00:00 2026-02-13T01:21:23.255 INFO:teuthology.orchestra.run.trial154.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 683 kB/s | 27 kB 00:00 2026-02-13T01:21:23.295 INFO:teuthology.orchestra.run.trial154.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 933 kB/s | 37 kB 00:00 2026-02-13T01:21:23.336 INFO:teuthology.orchestra.run.trial154.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 603 kB/s | 24 kB 00:00 2026-02-13T01:21:23.634 INFO:teuthology.orchestra.run.trial126.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 1.5 MB/s | 13 MB 00:08 2026-02-13T01:21:23.681 INFO:teuthology.orchestra.run.trial126.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 976 kB/s | 45 kB 00:00 2026-02-13T01:21:23.741 INFO:teuthology.orchestra.run.trial154.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 2.2 MB/s | 909 kB 00:00 2026-02-13T01:21:23.822 INFO:teuthology.orchestra.run.trial126.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 1.3 MB/s | 185 kB 00:00 2026-02-13T01:21:23.834 INFO:teuthology.orchestra.run.trial154.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 1.7 MB/s | 159 kB 00:00 2026-02-13T01:21:23.929 INFO:teuthology.orchestra.run.trial154.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 1.3 MB/s | 123 kB 00:00 2026-02-13T01:21:23.963 INFO:teuthology.orchestra.run.trial126.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 1.4 MB/s | 204 kB 00:00 2026-02-13T01:21:24.075 INFO:teuthology.orchestra.run.trial154.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 1.7 MB/s | 248 kB 00:00 2026-02-13T01:21:24.080 INFO:teuthology.orchestra.run.trial091.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 1.5 MB/s | 13 MB 00:08 2026-02-13T01:21:24.129 INFO:teuthology.orchestra.run.trial091.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 916 kB/s | 45 kB 00:00 2026-02-13T01:21:24.214 INFO:teuthology.orchestra.run.trial126.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 1.3 MB/s | 324 kB 00:00 2026-02-13T01:21:24.286 INFO:teuthology.orchestra.run.trial091.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 1.1 MB/s | 185 kB 00:00 2026-02-13T01:21:24.451 INFO:teuthology.orchestra.run.trial091.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 1.2 MB/s | 204 kB 00:00 2026-02-13T01:21:24.485 INFO:teuthology.orchestra.run.trial126.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 1.1 MB/s | 306 kB 00:00 2026-02-13T01:21:24.600 INFO:teuthology.orchestra.run.trial126.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 873 kB/s | 100 kB 00:00 2026-02-13T01:21:24.716 INFO:teuthology.orchestra.run.trial126.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 724 kB/s | 84 kB 00:00 2026-02-13T01:21:24.735 INFO:teuthology.orchestra.run.trial091.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 1.1 MB/s | 324 kB 00:00 2026-02-13T01:21:24.784 INFO:teuthology.orchestra.run.trial126.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 2.7 MB/s | 6.5 MB 00:02 2026-02-13T01:21:24.905 INFO:teuthology.orchestra.run.trial126.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 1.4 MB/s | 172 kB 00:00 2026-02-13T01:21:24.967 INFO:teuthology.orchestra.run.trial126.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 920 kB/s | 57 kB 00:00 2026-02-13T01:21:24.976 INFO:teuthology.orchestra.run.trial091.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 1.2 MB/s | 306 kB 00:00 2026-02-13T01:21:25.096 INFO:teuthology.orchestra.run.trial126.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.4 MB/s | 183 kB 00:00 2026-02-13T01:21:25.102 INFO:teuthology.orchestra.run.trial091.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 798 kB/s | 100 kB 00:00 2026-02-13T01:21:25.231 INFO:teuthology.orchestra.run.trial091.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 655 kB/s | 84 kB 00:00 2026-02-13T01:21:26.440 INFO:teuthology.orchestra.run.trial154.stdout:(21/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 1.5 MB/s | 13 MB 00:08 2026-02-13T01:21:26.501 INFO:teuthology.orchestra.run.trial154.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 748 kB/s | 45 kB 00:00 2026-02-13T01:21:26.630 INFO:teuthology.orchestra.run.trial154.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 1.4 MB/s | 185 kB 00:00 2026-02-13T01:21:26.771 INFO:teuthology.orchestra.run.trial154.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 1.4 MB/s | 204 kB 00:00 2026-02-13T01:21:27.037 INFO:teuthology.orchestra.run.trial154.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 1.2 MB/s | 324 kB 00:00 2026-02-13T01:21:27.182 INFO:teuthology.orchestra.run.trial126.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 1.2 MB/s | 2.9 MB 00:02 2026-02-13T01:21:27.236 INFO:teuthology.orchestra.run.trial154.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 1.5 MB/s | 306 kB 00:00 2026-02-13T01:21:27.306 INFO:teuthology.orchestra.run.trial154.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.4 MB/s | 100 kB 00:00 2026-02-13T01:21:27.343 INFO:teuthology.orchestra.run.trial091.stdout:(29/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 1.4 MB/s | 2.9 MB 00:02 2026-02-13T01:21:27.371 INFO:teuthology.orchestra.run.trial154.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.3 MB/s | 84 kB 00:00 2026-02-13T01:21:27.477 INFO:teuthology.orchestra.run.trial091.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 1.3 MB/s | 172 kB 00:00 2026-02-13T01:21:27.547 INFO:teuthology.orchestra.run.trial091.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 821 kB/s | 57 kB 00:00 2026-02-13T01:21:27.691 INFO:teuthology.orchestra.run.trial091.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.2 MB/s | 183 kB 00:00 2026-02-13T01:21:28.230 INFO:teuthology.orchestra.run.trial154.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 1.6 MB/s | 6.5 MB 00:04 2026-02-13T01:21:28.355 INFO:teuthology.orchestra.run.trial154.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 1.3 MB/s | 172 kB 00:00 2026-02-13T01:21:28.420 INFO:teuthology.orchestra.run.trial154.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 880 kB/s | 57 kB 00:00 2026-02-13T01:21:28.545 INFO:teuthology.orchestra.run.trial154.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.4 MB/s | 183 kB 00:00 2026-02-13T01:21:29.212 INFO:teuthology.orchestra.run.trial091.stdout:(33/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 992 kB/s | 6.5 MB 00:06 2026-02-13T01:21:29.337 INFO:teuthology.orchestra.run.trial154.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 1.5 MB/s | 2.9 MB 00:01 2026-02-13T01:21:31.276 INFO:teuthology.orchestra.run.trial126.stdout:(34/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 2.4 MB/s | 15 MB 00:06 2026-02-13T01:21:31.456 INFO:teuthology.orchestra.run.trial126.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 1.6 MB/s | 297 kB 00:00 2026-02-13T01:21:31.519 INFO:teuthology.orchestra.run.trial126.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 801 kB/s | 50 kB 00:00 2026-02-13T01:21:31.582 INFO:teuthology.orchestra.run.trial126.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 276 kB/s | 17 kB 00:00 2026-02-13T01:21:31.769 INFO:teuthology.orchestra.run.trial126.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 1.6 MB/s | 299 kB 00:00 2026-02-13T01:21:32.294 INFO:teuthology.orchestra.run.trial126.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 1.9 MB/s | 1.0 MB 00:00 2026-02-13T01:21:32.359 INFO:teuthology.orchestra.run.trial126.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 282 kB/s | 18 kB 00:00 2026-02-13T01:21:32.709 INFO:teuthology.orchestra.run.trial126.stdout:(41/173): ceph-mgr-diskprediction-local-20.3.0- 1.3 MB/s | 7.4 MB 00:05 2026-02-13T01:21:33.381 INFO:teuthology.orchestra.run.trial126.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 343 kB/s | 350 kB 00:01 2026-02-13T01:21:33.539 INFO:teuthology.orchestra.run.trial126.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 257 kB/s | 40 kB 00:00 2026-02-13T01:21:33.703 INFO:teuthology.orchestra.run.trial126.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 139 kB/s | 23 kB 00:00 2026-02-13T01:21:33.865 INFO:teuthology.orchestra.run.trial091.stdout:(34/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 2.4 MB/s | 15 MB 00:06 2026-02-13T01:21:33.939 INFO:teuthology.orchestra.run.trial126.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 305 kB/s | 72 kB 00:00 2026-02-13T01:21:33.990 INFO:teuthology.orchestra.run.trial091.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 2.3 MB/s | 297 kB 00:00 2026-02-13T01:21:34.051 INFO:teuthology.orchestra.run.trial091.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 822 kB/s | 50 kB 00:00 2026-02-13T01:21:34.112 INFO:teuthology.orchestra.run.trial091.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 288 kB/s | 17 kB 00:00 2026-02-13T01:21:34.125 INFO:teuthology.orchestra.run.trial154.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 1.5 MB/s | 7.4 MB 00:04 2026-02-13T01:21:34.234 INFO:teuthology.orchestra.run.trial091.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 2.4 MB/s | 299 kB 00:00 2026-02-13T01:21:34.313 INFO:teuthology.orchestra.run.trial154.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 1.5 MB/s | 297 kB 00:00 2026-02-13T01:21:34.377 INFO:teuthology.orchestra.run.trial154.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 793 kB/s | 50 kB 00:00 2026-02-13T01:21:34.440 INFO:teuthology.orchestra.run.trial154.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 276 kB/s | 17 kB 00:00 2026-02-13T01:21:34.483 INFO:teuthology.orchestra.run.trial091.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 4.1 MB/s | 1.0 MB 00:00 2026-02-13T01:21:34.540 INFO:teuthology.orchestra.run.trial091.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 323 kB/s | 18 kB 00:00 2026-02-13T01:21:34.592 INFO:teuthology.orchestra.run.trial091.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 6.6 MB/s | 350 kB 00:00 2026-02-13T01:21:34.608 INFO:teuthology.orchestra.run.trial154.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 1.7 MB/s | 299 kB 00:00 2026-02-13T01:21:34.626 INFO:teuthology.orchestra.run.trial091.stdout:(42/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 63 MB/s | 2.1 MB 00:00 2026-02-13T01:21:34.635 INFO:teuthology.orchestra.run.trial091.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.6 MB/s | 40 kB 00:00 2026-02-13T01:21:34.643 INFO:teuthology.orchestra.run.trial091.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 2.8 MB/s | 23 kB 00:00 2026-02-13T01:21:34.652 INFO:teuthology.orchestra.run.trial091.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 7.9 MB/s | 72 kB 00:00 2026-02-13T01:21:34.667 INFO:teuthology.orchestra.run.trial091.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 54 MB/s | 794 kB 00:00 2026-02-13T01:21:34.677 INFO:teuthology.orchestra.run.trial091.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-13T01:21:34.686 INFO:teuthology.orchestra.run.trial091.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 10 MB/s | 94 kB 00:00 2026-02-13T01:21:34.695 INFO:teuthology.orchestra.run.trial091.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 4.0 MB/s | 33 kB 00:00 2026-02-13T01:21:34.703 INFO:teuthology.orchestra.run.trial091.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 11 MB/s | 93 kB 00:00 2026-02-13T01:21:34.715 INFO:teuthology.orchestra.run.trial091.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-13T01:21:34.729 INFO:teuthology.orchestra.run.trial091.stdout:(52/173): python3-cryptography-36.0.1-5.el9.x86 88 MB/s | 1.2 MB 00:00 2026-02-13T01:21:34.739 INFO:teuthology.orchestra.run.trial091.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 10 MB/s | 106 kB 00:00 2026-02-13T01:21:34.750 INFO:teuthology.orchestra.run.trial091.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 13 MB/s | 135 kB 00:00 2026-02-13T01:21:34.760 INFO:teuthology.orchestra.run.trial091.stdout:(55/173): python3-requests-2.25.1-10.el9.noarch 12 MB/s | 126 kB 00:00 2026-02-13T01:21:34.771 INFO:teuthology.orchestra.run.trial091.stdout:(56/173): python3-urllib3-1.26.5-7.el9.noarch.r 19 MB/s | 218 kB 00:00 2026-02-13T01:21:34.782 INFO:teuthology.orchestra.run.trial091.stdout:(57/173): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-13T01:21:34.793 INFO:teuthology.orchestra.run.trial091.stdout:(58/173): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-13T01:21:34.865 INFO:teuthology.orchestra.run.trial091.stdout:(59/173): ceph-mgr-diskprediction-local-20.3.0- 1.3 MB/s | 7.4 MB 00:05 2026-02-13T01:21:34.953 INFO:teuthology.orchestra.run.trial126.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 783 kB/s | 794 kB 00:01 2026-02-13T01:21:34.984 INFO:teuthology.orchestra.run.trial091.stdout:(60/173): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2026-02-13T01:21:35.010 INFO:teuthology.orchestra.run.trial091.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 3.9 MB/s | 104 kB 00:00 2026-02-13T01:21:35.036 INFO:teuthology.orchestra.run.trial091.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 3.0 MB/s | 79 kB 00:00 2026-02-13T01:21:35.068 INFO:teuthology.orchestra.run.trial091.stdout:(63/173): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 943 kB 00:00 2026-02-13T01:21:35.068 INFO:teuthology.orchestra.run.trial091.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 9.6 MB/s | 313 kB 00:00 2026-02-13T01:21:35.094 INFO:teuthology.orchestra.run.trial091.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 33 kB 00:00 2026-02-13T01:21:35.095 INFO:teuthology.orchestra.run.trial154.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 2.1 MB/s | 1.0 MB 00:00 2026-02-13T01:21:35.120 INFO:teuthology.orchestra.run.trial091.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 718 kB/s | 18 kB 00:00 2026-02-13T01:21:35.153 INFO:teuthology.orchestra.run.trial154.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 317 kB/s | 18 kB 00:00 2026-02-13T01:21:35.182 INFO:teuthology.orchestra.run.trial091.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 177 kB/s | 11 kB 00:00 2026-02-13T01:21:35.186 INFO:teuthology.orchestra.run.trial154.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 10 MB/s | 350 kB 00:00 2026-02-13T01:21:35.203 INFO:teuthology.orchestra.run.trial154.stdout:(42/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 123 MB/s | 2.1 MB 00:00 2026-02-13T01:21:35.205 INFO:teuthology.orchestra.run.trial091.stdout:(68/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2026-02-13T01:21:35.208 INFO:teuthology.orchestra.run.trial154.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 8.9 MB/s | 40 kB 00:00 2026-02-13T01:21:35.209 INFO:teuthology.orchestra.run.trial091.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 6.0 MB/s | 164 kB 00:00 2026-02-13T01:21:35.212 INFO:teuthology.orchestra.run.trial154.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 5.6 MB/s | 23 kB 00:00 2026-02-13T01:21:35.217 INFO:teuthology.orchestra.run.trial154.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-13T01:21:35.225 INFO:teuthology.orchestra.run.trial154.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 96 MB/s | 794 kB 00:00 2026-02-13T01:21:35.230 INFO:teuthology.orchestra.run.trial091.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.2 MB/s | 160 kB 00:00 2026-02-13T01:21:35.231 INFO:teuthology.orchestra.run.trial154.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 29 MB/s | 184 kB 00:00 2026-02-13T01:21:35.235 INFO:teuthology.orchestra.run.trial091.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T01:21:35.238 INFO:teuthology.orchestra.run.trial154.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 15 MB/s | 94 kB 00:00 2026-02-13T01:21:35.242 INFO:teuthology.orchestra.run.trial154.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 7.9 MB/s | 33 kB 00:00 2026-02-13T01:21:35.247 INFO:teuthology.orchestra.run.trial154.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 21 MB/s | 93 kB 00:00 2026-02-13T01:21:35.254 INFO:teuthology.orchestra.run.trial154.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 34 MB/s | 253 kB 00:00 2026-02-13T01:21:35.259 INFO:teuthology.orchestra.run.trial091.stdout:(72/173): librdkafka-1.6.1-102.el9.x86_64.rpm 22 MB/s | 662 kB 00:00 2026-02-13T01:21:35.267 INFO:teuthology.orchestra.run.trial126.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 588 kB/s | 184 kB 00:00 2026-02-13T01:21:35.288 INFO:teuthology.orchestra.run.trial091.stdout:(73/173): libtool-2.4.6-46.el9.x86_64.rpm 20 MB/s | 581 kB 00:00 2026-02-13T01:21:35.289 INFO:teuthology.orchestra.run.trial154.stdout:(52/173): python3-cryptography-36.0.1-5.el9.x86 36 MB/s | 1.2 MB 00:00 2026-02-13T01:21:35.295 INFO:teuthology.orchestra.run.trial154.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 17 MB/s | 106 kB 00:00 2026-02-13T01:21:35.297 INFO:teuthology.orchestra.run.trial091.stdout:(74/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 3.9 MB/s | 246 kB 00:00 2026-02-13T01:21:35.302 INFO:teuthology.orchestra.run.trial154.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 20 MB/s | 135 kB 00:00 2026-02-13T01:21:35.308 INFO:teuthology.orchestra.run.trial154.stdout:(55/173): python3-requests-2.25.1-10.el9.noarch 20 MB/s | 126 kB 00:00 2026-02-13T01:21:35.312 INFO:teuthology.orchestra.run.trial091.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 1.0 MB/s | 25 kB 00:00 2026-02-13T01:21:35.315 INFO:teuthology.orchestra.run.trial154.stdout:(56/173): python3-urllib3-1.26.5-7.el9.noarch.r 32 MB/s | 218 kB 00:00 2026-02-13T01:21:35.322 INFO:teuthology.orchestra.run.trial154.stdout:(57/173): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-13T01:21:35.325 INFO:teuthology.orchestra.run.trial091.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 8.1 MB/s | 233 kB 00:00 2026-02-13T01:21:35.328 INFO:teuthology.orchestra.run.trial154.stdout:(58/173): zip-3.0-35.el9.x86_64.rpm 41 MB/s | 266 kB 00:00 2026-02-13T01:21:35.337 INFO:teuthology.orchestra.run.trial091.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 2.0 MB/s | 51 kB 00:00 2026-02-13T01:21:35.355 INFO:teuthology.orchestra.run.trial091.stdout:(78/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.7 MB/s | 292 kB 00:00 2026-02-13T01:21:35.362 INFO:teuthology.orchestra.run.trial091.stdout:(79/173): lua-5.4.4-4.el9.x86_64.rpm 7.3 MB/s | 188 kB 00:00 2026-02-13T01:21:35.380 INFO:teuthology.orchestra.run.trial091.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T01:21:35.426 INFO:teuthology.orchestra.run.trial091.stdout:(81/173): openblas-openmp-0.3.29-1.el9.x86_64.r 84 MB/s | 5.3 MB 00:00 2026-02-13T01:21:35.450 INFO:teuthology.orchestra.run.trial091.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 907 kB/s | 22 kB 00:00 2026-02-13T01:21:35.471 INFO:teuthology.orchestra.run.trial091.stdout:(83/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 53 MB/s | 4.8 MB 00:00 2026-02-13T01:21:35.475 INFO:teuthology.orchestra.run.trial091.stdout:(84/173): perl-threads-2.25-460.el9.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2026-02-13T01:21:35.496 INFO:teuthology.orchestra.run.trial091.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-13T01:21:35.505 INFO:teuthology.orchestra.run.trial091.stdout:(86/173): postgresql-13.23-1.el9.x86_64.rpm 55 MB/s | 1.6 MB 00:00 2026-02-13T01:21:35.505 INFO:teuthology.orchestra.run.trial126.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 396 kB/s | 94 kB 00:00 2026-02-13T01:21:35.520 INFO:teuthology.orchestra.run.trial154.stdout:(59/173): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2026-02-13T01:21:35.530 INFO:teuthology.orchestra.run.trial091.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 5.4 MB/s | 138 kB 00:00 2026-02-13T01:21:35.540 INFO:teuthology.orchestra.run.trial091.stdout:(88/173): postgresql-contrib-13.23-1.el9.x86_64 20 MB/s | 903 kB 00:00 2026-02-13T01:21:35.570 INFO:teuthology.orchestra.run.trial091.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 34 MB/s | 1.0 MB 00:00 2026-02-13T01:21:35.577 INFO:teuthology.orchestra.run.trial154.stdout:(60/173): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2026-02-13T01:21:35.594 INFO:teuthology.orchestra.run.trial091.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 91 MB/s | 5.8 MB 00:00 2026-02-13T01:21:35.603 INFO:teuthology.orchestra.run.trial154.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 3.8 MB/s | 104 kB 00:00 2026-02-13T01:21:35.618 INFO:teuthology.orchestra.run.trial091.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 2.4 MB/s | 61 kB 00:00 2026-02-13T01:21:35.629 INFO:teuthology.orchestra.run.trial154.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 3.0 MB/s | 79 kB 00:00 2026-02-13T01:21:35.637 INFO:teuthology.orchestra.run.trial091.stdout:(92/173): python3-babel-2.9.1-2.el9.noarch.rpm 88 MB/s | 6.0 MB 00:00 2026-02-13T01:21:35.643 INFO:teuthology.orchestra.run.trial091.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 9.5 MB/s | 244 kB 00:00 2026-02-13T01:21:35.657 INFO:teuthology.orchestra.run.trial154.stdout:(63/173): flex-2.6.4-9.el9.x86_64.rpm 11 MB/s | 313 kB 00:00 2026-02-13T01:21:35.665 INFO:teuthology.orchestra.run.trial091.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 8.6 MB/s | 249 kB 00:00 2026-02-13T01:21:35.667 INFO:teuthology.orchestra.run.trial126.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 205 kB/s | 33 kB 00:00 2026-02-13T01:21:35.668 INFO:teuthology.orchestra.run.trial091.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 1.9 MB/s | 48 kB 00:00 2026-02-13T01:21:35.682 INFO:teuthology.orchestra.run.trial154.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 1.3 MB/s | 33 kB 00:00 2026-02-13T01:21:35.692 INFO:teuthology.orchestra.run.trial091.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.4 MB/s | 35 kB 00:00 2026-02-13T01:21:35.693 INFO:teuthology.orchestra.run.trial091.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 6.2 MB/s | 177 kB 00:00 2026-02-13T01:21:35.723 INFO:teuthology.orchestra.run.trial091.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 14 MB/s | 442 kB 00:00 2026-02-13T01:21:35.750 INFO:teuthology.orchestra.run.trial091.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 2.8 MB/s | 77 kB 00:00 2026-02-13T01:21:35.757 INFO:teuthology.orchestra.run.trial091.stdout:(100/173): python3-numpy-1.23.5-2.el9.x86_64.rp 95 MB/s | 6.1 MB 00:00 2026-02-13T01:21:35.772 INFO:teuthology.orchestra.run.trial154.stdout:(65/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2026-02-13T01:21:35.777 INFO:teuthology.orchestra.run.trial091.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 9.6 MB/s | 267 kB 00:00 2026-02-13T01:21:35.782 INFO:teuthology.orchestra.run.trial091.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 6.2 MB/s | 159 kB 00:00 2026-02-13T01:21:35.798 INFO:teuthology.orchestra.run.trial154.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 714 kB/s | 18 kB 00:00 2026-02-13T01:21:35.806 INFO:teuthology.orchestra.run.trial091.stdout:(103/173): python3-pyasn1-modules-0.4.8-6.el9.n 9.5 MB/s | 279 kB 00:00 2026-02-13T01:21:35.807 INFO:teuthology.orchestra.run.trial091.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 2.1 MB/s | 54 kB 00:00 2026-02-13T01:21:35.823 INFO:teuthology.orchestra.run.trial154.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 439 kB/s | 11 kB 00:00 2026-02-13T01:21:35.832 INFO:teuthology.orchestra.run.trial091.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T01:21:35.851 INFO:teuthology.orchestra.run.trial154.stdout:(68/173): libnbd-1.20.3-4.el9.x86_64.rpm 5.8 MB/s | 164 kB 00:00 2026-02-13T01:21:35.856 INFO:teuthology.orchestra.run.trial091.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.7 MB/s | 44 kB 00:00 2026-02-13T01:21:35.879 INFO:teuthology.orchestra.run.trial154.stdout:(69/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.5 MB/s | 160 kB 00:00 2026-02-13T01:21:35.882 INFO:teuthology.orchestra.run.trial091.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 9.2 MB/s | 240 kB 00:00 2026-02-13T01:21:35.904 INFO:teuthology.orchestra.run.trial126.stdout:(50/173): pciutils-3.7.0-7.el9.x86_64.rpm 392 kB/s | 93 kB 00:00 2026-02-13T01:21:35.905 INFO:teuthology.orchestra.run.trial154.stdout:(70/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T01:21:35.906 INFO:teuthology.orchestra.run.trial091.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 1.5 MB/s | 37 kB 00:00 2026-02-13T01:21:35.931 INFO:teuthology.orchestra.run.trial091.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.6 MB/s | 66 kB 00:00 2026-02-13T01:21:35.935 INFO:teuthology.orchestra.run.trial154.stdout:(71/173): librdkafka-1.6.1-102.el9.x86_64.rpm 22 MB/s | 662 kB 00:00 2026-02-13T01:21:35.956 INFO:teuthology.orchestra.run.trial091.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-13T01:21:35.962 INFO:teuthology.orchestra.run.trial154.stdout:(72/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.8 MB/s | 246 kB 00:00 2026-02-13T01:21:35.981 INFO:teuthology.orchestra.run.trial091.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2026-02-13T01:21:35.991 INFO:teuthology.orchestra.run.trial154.stdout:(73/173): libtool-2.4.6-46.el9.x86_64.rpm 20 MB/s | 581 kB 00:00 2026-02-13T01:21:36.006 INFO:teuthology.orchestra.run.trial091.stdout:(112/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.8 MB/s | 96 kB 00:00 2026-02-13T01:21:36.017 INFO:teuthology.orchestra.run.trial154.stdout:(74/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 967 kB/s | 25 kB 00:00 2026-02-13T01:21:36.030 INFO:teuthology.orchestra.run.trial091.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-13T01:21:36.044 INFO:teuthology.orchestra.run.trial154.stdout:(75/173): libxslt-1.1.34-12.el9.x86_64.rpm 8.4 MB/s | 233 kB 00:00 2026-02-13T01:21:36.055 INFO:teuthology.orchestra.run.trial091.stdout:(114/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.8 MB/s | 45 kB 00:00 2026-02-13T01:21:36.069 INFO:teuthology.orchestra.run.trial154.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 1.9 MB/s | 51 kB 00:00 2026-02-13T01:21:36.081 INFO:teuthology.orchestra.run.trial091.stdout:(115/173): lua-devel-5.4.4-4.el9.x86_64.rpm 859 kB/s | 22 kB 00:00 2026-02-13T01:21:36.100 INFO:teuthology.orchestra.run.trial154.stdout:(77/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.3 MB/s | 292 kB 00:00 2026-02-13T01:21:36.128 INFO:teuthology.orchestra.run.trial154.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2026-02-13T01:21:36.133 INFO:teuthology.orchestra.run.trial091.stdout:(116/173): protobuf-compiler-3.14.0-17.el9.x86_ 16 MB/s | 862 kB 00:00 2026-02-13T01:21:36.153 INFO:teuthology.orchestra.run.trial154.stdout:(79/173): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T01:21:36.275 INFO:teuthology.orchestra.run.trial091.stdout:(117/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 41 MB/s | 19 MB 00:00 2026-02-13T01:21:36.303 INFO:teuthology.orchestra.run.trial126.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 635 kB/s | 253 kB 00:00 2026-02-13T01:21:36.306 INFO:teuthology.orchestra.run.trial154.stdout:(80/173): openblas-openmp-0.3.29-1.el9.x86_64.r 35 MB/s | 5.3 MB 00:00 2026-02-13T01:21:36.387 INFO:teuthology.orchestra.run.trial154.stdout:(81/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 60 MB/s | 4.8 MB 00:00 2026-02-13T01:21:36.412 INFO:teuthology.orchestra.run.trial154.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 871 kB/s | 22 kB 00:00 2026-02-13T01:21:36.418 INFO:teuthology.orchestra.run.trial091.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.9 MB/s | 551 kB 00:00 2026-02-13T01:21:36.424 INFO:teuthology.orchestra.run.trial091.stdout:(119/173): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2026-02-13T01:21:36.438 INFO:teuthology.orchestra.run.trial154.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T01:21:36.463 INFO:teuthology.orchestra.run.trial154.stdout:(84/173): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-13T01:21:36.485 INFO:teuthology.orchestra.run.trial091.stdout:(120/173): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2026-02-13T01:21:36.494 INFO:teuthology.orchestra.run.trial154.stdout:(85/173): postgresql-13.23-1.el9.x86_64.rpm 53 MB/s | 1.6 MB 00:00 2026-02-13T01:21:36.524 INFO:teuthology.orchestra.run.trial154.stdout:(86/173): postgresql-contrib-13.23-1.el9.x86_64 29 MB/s | 903 kB 00:00 2026-02-13T01:21:36.551 INFO:teuthology.orchestra.run.trial154.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 5.0 MB/s | 138 kB 00:00 2026-02-13T01:21:36.630 INFO:teuthology.orchestra.run.trial154.stdout:(88/173): postgresql-server-13.23-1.el9.x86_64. 73 MB/s | 5.8 MB 00:00 2026-02-13T01:21:36.660 INFO:teuthology.orchestra.run.trial091.stdout:(121/173): libarrow-9.0.0-15.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2026-02-13T01:21:36.660 INFO:teuthology.orchestra.run.trial154.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 34 MB/s | 1.0 MB 00:00 2026-02-13T01:21:36.661 INFO:teuthology.orchestra.run.trial126.stdout:(52/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 544 kB/s | 2.1 MB 00:03 2026-02-13T01:21:36.725 INFO:teuthology.orchestra.run.trial154.stdout:(90/173): python3-babel-2.9.1-2.el9.noarch.rpm 93 MB/s | 6.0 MB 00:00 2026-02-13T01:21:36.751 INFO:teuthology.orchestra.run.trial154.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 2.3 MB/s | 61 kB 00:00 2026-02-13T01:21:36.754 INFO:teuthology.orchestra.run.trial091.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 92 kB/s | 25 kB 00:00 2026-02-13T01:21:36.779 INFO:teuthology.orchestra.run.trial154.stdout:(92/173): python3-devel-3.9.25-2.el9.x86_64.rpm 8.8 MB/s | 244 kB 00:00 2026-02-13T01:21:36.807 INFO:teuthology.orchestra.run.trial154.stdout:(93/173): python3-jinja2-2.11.3-8.el9.noarch.rp 8.6 MB/s | 249 kB 00:00 2026-02-13T01:21:36.833 INFO:teuthology.orchestra.run.trial154.stdout:(94/173): python3-jmespath-1.0.1-1.el9.noarch.r 1.8 MB/s | 48 kB 00:00 2026-02-13T01:21:36.860 INFO:teuthology.orchestra.run.trial154.stdout:(95/173): python3-libstoragemgmt-1.10.1-1.el9.x 6.4 MB/s | 177 kB 00:00 2026-02-13T01:21:36.886 INFO:teuthology.orchestra.run.trial154.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 1.3 MB/s | 35 kB 00:00 2026-02-13T01:21:36.898 INFO:teuthology.orchestra.run.trial126.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 448 kB/s | 106 kB 00:00 2026-02-13T01:21:36.912 INFO:teuthology.orchestra.run.trial091.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 193 kB/s | 49 kB 00:00 2026-02-13T01:21:36.925 INFO:teuthology.orchestra.run.trial091.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 393 kB/s | 67 kB 00:00 2026-02-13T01:21:36.950 INFO:teuthology.orchestra.run.trial154.stdout:(97/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 96 MB/s | 6.1 MB 00:00 2026-02-13T01:21:36.979 INFO:teuthology.orchestra.run.trial154.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 15 MB/s | 442 kB 00:00 2026-02-13T01:21:36.998 INFO:teuthology.orchestra.run.trial091.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2026-02-13T01:21:37.005 INFO:teuthology.orchestra.run.trial154.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 2.9 MB/s | 77 kB 00:00 2026-02-13T01:21:37.032 INFO:teuthology.orchestra.run.trial154.stdout:(100/173): python3-protobuf-3.14.0-17.el9.noarc 9.7 MB/s | 267 kB 00:00 2026-02-13T01:21:37.060 INFO:teuthology.orchestra.run.trial154.stdout:(101/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 5.6 MB/s | 159 kB 00:00 2026-02-13T01:21:37.088 INFO:teuthology.orchestra.run.trial154.stdout:(102/173): python3-pyasn1-modules-0.4.8-6.el9.n 9.7 MB/s | 279 kB 00:00 2026-02-13T01:21:37.114 INFO:teuthology.orchestra.run.trial154.stdout:(103/173): python3-requests-oauthlib-1.3.0-12.e 2.0 MB/s | 54 kB 00:00 2026-02-13T01:21:37.164 INFO:teuthology.orchestra.run.trial091.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2026-02-13T01:21:37.214 INFO:teuthology.orchestra.run.trial126.stdout:(54/173): python3-pycparser-2.20-6.el9.noarch.r 428 kB/s | 135 kB 00:00 2026-02-13T01:21:37.291 INFO:teuthology.orchestra.run.trial154.stdout:(104/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 109 MB/s | 19 MB 00:00 2026-02-13T01:21:37.317 INFO:teuthology.orchestra.run.trial154.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 1.6 MB/s | 42 kB 00:00 2026-02-13T01:21:37.324 INFO:teuthology.orchestra.run.trial091.stdout:(127/173): python3-asyncssh-2.13.2-5.el9.noarch 1.6 MB/s | 548 kB 00:00 2026-02-13T01:21:37.343 INFO:teuthology.orchestra.run.trial154.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 1.7 MB/s | 44 kB 00:00 2026-02-13T01:21:37.369 INFO:teuthology.orchestra.run.trial154.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 9.0 MB/s | 240 kB 00:00 2026-02-13T01:21:37.395 INFO:teuthology.orchestra.run.trial154.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 1.4 MB/s | 37 kB 00:00 2026-02-13T01:21:37.420 INFO:teuthology.orchestra.run.trial154.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-13T01:21:37.447 INFO:teuthology.orchestra.run.trial154.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 11 MB/s | 303 kB 00:00 2026-02-13T01:21:37.452 INFO:teuthology.orchestra.run.trial126.stdout:(55/173): python3-requests-2.25.1-10.el9.noarch 532 kB/s | 126 kB 00:00 2026-02-13T01:21:37.473 INFO:teuthology.orchestra.run.trial154.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 58 kB 00:00 2026-02-13T01:21:37.499 INFO:teuthology.orchestra.run.trial154.stdout:(112/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.6 MB/s | 96 kB 00:00 2026-02-13T01:21:37.507 INFO:teuthology.orchestra.run.trial091.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 86 kB/s | 29 kB 00:00 2026-02-13T01:21:37.509 INFO:teuthology.orchestra.run.trial091.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 323 kB/s | 60 kB 00:00 2026-02-13T01:21:37.525 INFO:teuthology.orchestra.run.trial154.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-13T01:21:37.550 INFO:teuthology.orchestra.run.trial154.stdout:(114/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-13T01:21:37.579 INFO:teuthology.orchestra.run.trial091.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 605 kB/s | 43 kB 00:00 2026-02-13T01:21:37.611 INFO:teuthology.orchestra.run.trial091.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 318 kB/s | 32 kB 00:00 2026-02-13T01:21:37.678 INFO:teuthology.orchestra.run.trial091.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 144 kB/s | 14 kB 00:00 2026-02-13T01:21:37.846 INFO:teuthology.orchestra.run.trial126.stdout:(56/173): python3-urllib3-1.26.5-7.el9.noarch.r 552 kB/s | 218 kB 00:00 2026-02-13T01:21:37.852 INFO:teuthology.orchestra.run.trial091.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 718 kB/s | 173 kB 00:00 2026-02-13T01:21:37.896 INFO:teuthology.orchestra.run.trial126.stdout:(57/173): python3-cryptography-36.0.1-5.el9.x86 801 kB/s | 1.2 MB 00:01 2026-02-13T01:21:37.897 INFO:teuthology.orchestra.run.trial091.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2026-02-13T01:21:38.045 INFO:teuthology.orchestra.run.trial091.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2026-02-13T01:21:38.094 INFO:teuthology.orchestra.run.trial154.stdout:(115/173): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2026-02-13T01:21:38.100 INFO:teuthology.orchestra.run.trial091.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 1.2 MB/s | 254 kB 00:00 2026-02-13T01:21:38.159 INFO:teuthology.orchestra.run.trial126.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 582 kB/s | 182 kB 00:00 2026-02-13T01:21:38.276 INFO:teuthology.orchestra.run.trial091.stdout:(137/173): python3-grpcio-1.46.7-10.el9.x86_64. 8.8 MB/s | 2.0 MB 00:00 2026-02-13T01:21:38.315 INFO:teuthology.orchestra.run.trial091.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 675 kB/s | 144 kB 00:00 2026-02-13T01:21:38.333 INFO:teuthology.orchestra.run.trial091.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 188 kB/s | 11 kB 00:00 2026-02-13T01:21:38.338 INFO:teuthology.orchestra.run.trial126.stdout:(59/173): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2026-02-13T01:21:38.356 INFO:teuthology.orchestra.run.trial091.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 431 kB/s | 18 kB 00:00 2026-02-13T01:21:38.368 INFO:teuthology.orchestra.run.trial126.stdout:(60/173): zip-3.0-35.el9.x86_64.rpm 563 kB/s | 266 kB 00:00 2026-02-13T01:21:38.373 INFO:teuthology.orchestra.run.trial091.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 588 kB/s | 23 kB 00:00 2026-02-13T01:21:38.401 INFO:teuthology.orchestra.run.trial091.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 430 kB/s | 20 kB 00:00 2026-02-13T01:21:38.413 INFO:teuthology.orchestra.run.trial091.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 485 kB/s | 19 kB 00:00 2026-02-13T01:21:38.430 INFO:teuthology.orchestra.run.trial091.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 922 kB/s | 26 kB 00:00 2026-02-13T01:21:38.482 INFO:teuthology.orchestra.run.trial126.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 913 kB/s | 104 kB 00:00 2026-02-13T01:21:38.504 INFO:teuthology.orchestra.run.trial091.stdout:(145/173): python3-kubernetes-26.1.0-3.el9.noar 11 MB/s | 1.0 MB 00:00 2026-02-13T01:21:38.510 INFO:teuthology.orchestra.run.trial126.stdout:(62/173): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2026-02-13T01:21:38.533 INFO:teuthology.orchestra.run.trial091.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 767 kB/s | 79 kB 00:00 2026-02-13T01:21:38.552 INFO:teuthology.orchestra.run.trial091.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2026-02-13T01:21:38.573 INFO:teuthology.orchestra.run.trial126.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 867 kB/s | 79 kB 00:00 2026-02-13T01:21:38.626 INFO:teuthology.orchestra.run.trial091.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 176 kB/s | 16 kB 00:00 2026-02-13T01:21:38.639 INFO:teuthology.orchestra.run.trial126.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2026-02-13T01:21:38.640 INFO:teuthology.orchestra.run.trial126.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2026-02-13T01:21:38.641 INFO:teuthology.orchestra.run.trial091.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2026-02-13T01:21:38.675 INFO:teuthology.orchestra.run.trial091.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 592 kB/s | 28 kB 00:00 2026-02-13T01:21:38.675 INFO:teuthology.orchestra.run.trial091.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 922 kB/s | 31 kB 00:00 2026-02-13T01:21:38.701 INFO:teuthology.orchestra.run.trial091.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 6.8 MB/s | 188 kB 00:00 2026-02-13T01:21:38.703 INFO:teuthology.orchestra.run.trial154.stdout:(116/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d 1.5 MB/s | 15 MB 00:10 2026-02-13T01:21:38.705 INFO:teuthology.orchestra.run.trial126.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 281 kB/s | 18 kB 00:00 2026-02-13T01:21:38.711 INFO:teuthology.orchestra.run.trial091.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 1.6 MB/s | 59 kB 00:00 2026-02-13T01:21:38.741 INFO:teuthology.orchestra.run.trial091.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 901 kB/s | 36 kB 00:00 2026-02-13T01:21:38.793 INFO:teuthology.orchestra.run.trial091.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 1.0 MB/s | 86 kB 00:00 2026-02-13T01:21:38.821 INFO:teuthology.orchestra.run.trial091.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2026-02-13T01:21:38.841 INFO:teuthology.orchestra.run.trial126.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 82 kB/s | 11 kB 00:00 2026-02-13T01:21:38.853 INFO:teuthology.orchestra.run.trial091.stdout:(157/173): python3-xmltodict-0.12.0-15.el9.noar 372 kB/s | 22 kB 00:00 2026-02-13T01:21:38.854 INFO:teuthology.orchestra.run.trial091.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 614 kB/s | 20 kB 00:00 2026-02-13T01:21:38.930 INFO:teuthology.orchestra.run.trial091.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 2.4 MB/s | 191 kB 00:00 2026-02-13T01:21:38.986 INFO:teuthology.orchestra.run.trial126.stdout:(68/173): libnbd-1.20.3-4.el9.x86_64.rpm 1.1 MB/s | 164 kB 00:00 2026-02-13T01:21:38.995 INFO:teuthology.orchestra.run.trial154.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 956 kB/s | 862 kB 00:00 2026-02-13T01:21:39.109 INFO:teuthology.orchestra.run.trial126.stdout:(69/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2026-02-13T01:21:39.181 INFO:teuthology.orchestra.run.trial154.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.1 MB/s | 551 kB 00:00 2026-02-13T01:21:39.200 INFO:teuthology.orchestra.run.trial126.stdout:(70/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 497 kB/s | 45 kB 00:00 2026-02-13T01:21:39.248 INFO:teuthology.orchestra.run.trial154.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2026-02-13T01:21:39.336 INFO:teuthology.orchestra.run.trial091.stdout:(160/173): thrift-0.15.0-4.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2026-02-13T01:21:39.361 INFO:teuthology.orchestra.run.trial126.stdout:(71/173): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 662 kB 00:00 2026-02-13T01:21:39.405 INFO:teuthology.orchestra.run.trial154.stdout:(120/173): gperftools-libs-2.9.1-3.el9.x86_64.r 751 kB/s | 308 kB 00:00 2026-02-13T01:21:39.452 INFO:teuthology.orchestra.run.trial091.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 233 kB/s | 122 kB 00:00 2026-02-13T01:21:39.474 INFO:teuthology.orchestra.run.trial154.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 358 kB/s | 25 kB 00:00 2026-02-13T01:21:39.498 INFO:teuthology.orchestra.run.trial126.stdout:(72/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 1.8 MB/s | 246 kB 00:00 2026-02-13T01:21:39.544 INFO:teuthology.orchestra.run.trial154.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 704 kB/s | 49 kB 00:00 2026-02-13T01:21:39.586 INFO:teuthology.orchestra.run.trial154.stdout:(123/173): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-13T01:21:39.602 INFO:teuthology.orchestra.run.trial126.stdout:(73/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2026-02-13T01:21:39.614 INFO:teuthology.orchestra.run.trial154.stdout:(124/173): libunwind-1.6.2-1.el9.x86_64.rpm 961 kB/s | 67 kB 00:00 2026-02-13T01:21:39.655 INFO:teuthology.orchestra.run.trial154.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2026-02-13T01:21:39.677 INFO:teuthology.orchestra.run.trial126.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2026-02-13T01:21:39.700 INFO:teuthology.orchestra.run.trial126.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 252 kB/s | 25 kB 00:00 2026-02-13T01:21:39.740 INFO:teuthology.orchestra.run.trial154.stdout:(126/173): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2026-02-13T01:21:39.753 INFO:teuthology.orchestra.run.trial154.stdout:(127/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 5.9 MB/s | 838 kB 00:00 2026-02-13T01:21:39.785 INFO:teuthology.orchestra.run.trial126.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 593 kB/s | 51 kB 00:00 2026-02-13T01:21:39.823 INFO:teuthology.orchestra.run.trial154.stdout:(128/173): python3-backports-tarfile-1.2.0-1.el 855 kB/s | 60 kB 00:00 2026-02-13T01:21:39.848 INFO:teuthology.orchestra.run.trial126.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 1.3 MB/s | 233 kB 00:00 2026-02-13T01:21:39.894 INFO:teuthology.orchestra.run.trial154.stdout:(129/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 620 kB/s | 43 kB 00:00 2026-02-13T01:21:39.901 INFO:teuthology.orchestra.run.trial154.stdout:(130/173): python3-autocommand-2.2.2-8.el9.noar 182 kB/s | 29 kB 00:00 2026-02-13T01:21:39.922 INFO:teuthology.orchestra.run.trial126.stdout:(78/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2026-02-13T01:21:39.957 INFO:teuthology.orchestra.run.trial126.stdout:(79/173): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2026-02-13T01:21:39.964 INFO:teuthology.orchestra.run.trial154.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 459 kB/s | 32 kB 00:00 2026-02-13T01:21:39.969 INFO:teuthology.orchestra.run.trial154.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 209 kB/s | 14 kB 00:00 2026-02-13T01:21:40.013 INFO:teuthology.orchestra.run.trial126.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 462 kB/s | 42 kB 00:00 2026-02-13T01:21:40.036 INFO:teuthology.orchestra.run.trial154.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 2.4 MB/s | 173 kB 00:00 2026-02-13T01:21:40.048 INFO:teuthology.orchestra.run.trial154.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 4.4 MB/s | 358 kB 00:00 2026-02-13T01:21:40.112 INFO:teuthology.orchestra.run.trial154.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2026-02-13T01:21:40.119 INFO:teuthology.orchestra.run.trial154.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 3.5 MB/s | 254 kB 00:00 2026-02-13T01:21:40.122 INFO:teuthology.orchestra.run.trial091.stdout:(162/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 4.2 MB/s | 2.8 MB 00:00 2026-02-13T01:21:40.203 INFO:teuthology.orchestra.run.trial154.stdout:(137/173): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2026-02-13T01:21:40.209 INFO:teuthology.orchestra.run.trial091.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 27 MB/s | 2.4 MB 00:00 2026-02-13T01:21:40.229 INFO:teuthology.orchestra.run.trial091.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 94 MB/s | 1.9 MB 00:00 2026-02-13T01:21:40.238 INFO:teuthology.orchestra.run.trial091.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 4.0 MB/s | 37 kB 00:00 2026-02-13T01:21:40.249 INFO:teuthology.orchestra.run.trial091.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 23 MB/s | 248 kB 00:00 2026-02-13T01:21:40.262 INFO:teuthology.orchestra.run.trial091.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 67 MB/s | 866 kB 00:00 2026-02-13T01:21:40.262 INFO:teuthology.orchestra.run.trial126.stdout:(81/173): openblas-openmp-0.3.29-1.el9.x86_64.r 17 MB/s | 5.3 MB 00:00 2026-02-13T01:21:40.273 INFO:teuthology.orchestra.run.trial091.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 40 MB/s | 454 kB 00:00 2026-02-13T01:21:40.287 INFO:teuthology.orchestra.run.trial091.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 105 MB/s | 1.5 MB 00:00 2026-02-13T01:21:40.299 INFO:teuthology.orchestra.run.trial091.stdout:(170/173): openssl-fips-provider-3.5.5-1.el9.x8 66 MB/s | 814 kB 00:00 2026-02-13T01:21:40.300 INFO:teuthology.orchestra.run.trial126.stdout:(82/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2026-02-13T01:21:40.326 INFO:teuthology.orchestra.run.trial154.stdout:(138/173): python3-grpcio-1.46.7-10.el9.x86_64. 9.5 MB/s | 2.0 MB 00:00 2026-02-13T01:21:40.351 INFO:teuthology.orchestra.run.trial126.stdout:(83/173): perl-Thread-Queue-3.14-460.el9.noarch 251 kB/s | 22 kB 00:00 2026-02-13T01:21:40.375 INFO:teuthology.orchestra.run.trial091.stdout:(171/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 31 MB/s | 2.3 MB 00:00 2026-02-13T01:21:40.396 INFO:teuthology.orchestra.run.trial154.stdout:(139/173): python3-jaraco-classes-3.2.1-5.el9.n 253 kB/s | 18 kB 00:00 2026-02-13T01:21:40.414 INFO:teuthology.orchestra.run.trial154.stdout:(140/173): python3-jaraco-8.2.1-3.el9.noarch.rp 51 kB/s | 11 kB 00:00 2026-02-13T01:21:40.432 INFO:teuthology.orchestra.run.trial126.stdout:(84/173): perl-threads-2.25-460.el9.x86_64.rpm 445 kB/s | 58 kB 00:00 2026-02-13T01:21:40.455 INFO:teuthology.orchestra.run.trial126.stdout:(85/173): perl-threads-shared-1.61-460.el9.x86_ 427 kB/s | 45 kB 00:00 2026-02-13T01:21:40.466 INFO:teuthology.orchestra.run.trial154.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 332 kB/s | 23 kB 00:00 2026-02-13T01:21:40.519 INFO:teuthology.orchestra.run.trial154.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 187 kB/s | 20 kB 00:00 2026-02-13T01:21:40.536 INFO:teuthology.orchestra.run.trial154.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 279 kB/s | 19 kB 00:00 2026-02-13T01:21:40.599 INFO:teuthology.orchestra.run.trial154.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 331 kB/s | 26 kB 00:00 2026-02-13T01:21:40.665 INFO:teuthology.orchestra.run.trial126.stdout:(86/173): postgresql-13.23-1.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2026-02-13T01:21:40.683 INFO:teuthology.orchestra.run.trial126.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 3.9 MB/s | 903 kB 00:00 2026-02-13T01:21:40.733 INFO:teuthology.orchestra.run.trial154.stdout:(145/173): python3-more-itertools-8.12.0-2.el9. 585 kB/s | 79 kB 00:00 2026-02-13T01:21:40.779 INFO:teuthology.orchestra.run.trial126.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 1.2 MB/s | 138 kB 00:00 2026-02-13T01:21:40.802 INFO:teuthology.orchestra.run.trial154.stdout:(146/173): python3-natsort-7.1.1-5.el9.noarch.r 846 kB/s | 58 kB 00:00 2026-02-13T01:21:40.889 INFO:teuthology.orchestra.run.trial091.stdout:(172/173): librados2-20.3.0-5241.g8f8d3829.el9. 2.2 MB/s | 3.5 MB 00:01 2026-02-13T01:21:40.918 INFO:teuthology.orchestra.run.trial154.stdout:(147/173): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2026-02-13T01:21:40.966 INFO:teuthology.orchestra.run.trial126.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 5.4 MB/s | 1.0 MB 00:00 2026-02-13T01:21:41.040 INFO:teuthology.orchestra.run.trial154.stdout:(148/173): python3-kubernetes-26.1.0-3.el9.noar 2.0 MB/s | 1.0 MB 00:00 2026-02-13T01:21:41.049 INFO:teuthology.orchestra.run.trial126.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2026-02-13T01:21:41.068 INFO:teuthology.orchestra.run.trial154.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 599 kB/s | 90 kB 00:00 2026-02-13T01:21:41.110 INFO:teuthology.orchestra.run.trial154.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 403 kB/s | 28 kB 00:00 2026-02-13T01:21:41.181 INFO:teuthology.orchestra.run.trial154.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 273 kB/s | 31 kB 00:00 2026-02-13T01:21:41.182 INFO:teuthology.orchestra.run.trial154.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 2.6 MB/s | 188 kB 00:00 2026-02-13T01:21:41.193 INFO:teuthology.orchestra.run.trial126.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 425 kB/s | 61 kB 00:00 2026-02-13T01:21:41.252 INFO:teuthology.orchestra.run.trial154.stdout:(153/173): python3-tempora-5.0.0-2.el9.noarch.r 510 kB/s | 36 kB 00:00 2026-02-13T01:21:41.315 INFO:teuthology.orchestra.run.trial126.stdout:(92/173): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2026-02-13T01:21:41.319 INFO:teuthology.orchestra.run.trial154.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 427 kB/s | 59 kB 00:00 2026-02-13T01:21:41.323 INFO:teuthology.orchestra.run.trial154.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 1.2 MB/s | 86 kB 00:00 2026-02-13T01:21:41.330 INFO:teuthology.orchestra.run.trial126.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2026-02-13T01:21:41.393 INFO:teuthology.orchestra.run.trial154.stdout:(156/173): python3-xmltodict-0.12.0-15.el9.noar 318 kB/s | 22 kB 00:00 2026-02-13T01:21:41.422 INFO:teuthology.orchestra.run.trial126.stdout:(94/173): python3-jmespath-1.0.1-1.el9.noarch.r 520 kB/s | 48 kB 00:00 2026-02-13T01:21:41.422 INFO:teuthology.orchestra.run.trial154.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 871 kB/s | 90 kB 00:00 2026-02-13T01:21:41.452 INFO:teuthology.orchestra.run.trial126.stdout:(95/173): python3-jinja2-2.11.3-8.el9.noarch.rp 1.8 MB/s | 249 kB 00:00 2026-02-13T01:21:41.462 INFO:teuthology.orchestra.run.trial154.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 285 kB/s | 20 kB 00:00 2026-02-13T01:21:41.522 INFO:teuthology.orchestra.run.trial126.stdout:(96/173): python3-markupsafe-1.1.1-12.el9.x86_6 497 kB/s | 35 kB 00:00 2026-02-13T01:21:41.531 INFO:teuthology.orchestra.run.trial154.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2026-02-13T01:21:41.536 INFO:teuthology.orchestra.run.trial126.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 1.5 MB/s | 177 kB 00:00 2026-02-13T01:21:41.695 INFO:teuthology.orchestra.run.trial126.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 2.7 MB/s | 442 kB 00:00 2026-02-13T01:21:41.695 INFO:teuthology.orchestra.run.trial154.stdout:(160/173): thrift-0.15.0-4.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2026-02-13T01:21:41.735 INFO:teuthology.orchestra.run.trial154.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 598 kB/s | 122 kB 00:00 2026-02-13T01:21:41.787 INFO:teuthology.orchestra.run.trial126.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 835 kB/s | 77 kB 00:00 2026-02-13T01:21:41.831 INFO:teuthology.orchestra.run.trial126.stdout:(100/173): python3-numpy-1.23.5-2.el9.x86_64.rp 20 MB/s | 6.1 MB 00:00 2026-02-13T01:21:41.924 INFO:teuthology.orchestra.run.trial126.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 1.9 MB/s | 267 kB 00:00 2026-02-13T01:21:41.945 INFO:teuthology.orchestra.run.trial126.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.4 MB/s | 159 kB 00:00 2026-02-13T01:21:42.037 INFO:teuthology.orchestra.run.trial126.stdout:(103/173): python3-requests-oauthlib-1.3.0-12.e 580 kB/s | 54 kB 00:00 2026-02-13T01:21:42.061 INFO:teuthology.orchestra.run.trial126.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 2.0 MB/s | 279 kB 00:00 2026-02-13T01:21:42.152 INFO:teuthology.orchestra.run.trial126.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 459 kB/s | 42 kB 00:00 2026-02-13T01:21:42.290 INFO:teuthology.orchestra.run.trial126.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 319 kB/s | 44 kB 00:00 2026-02-13T01:21:42.425 INFO:teuthology.orchestra.run.trial126.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 1.7 MB/s | 240 kB 00:00 2026-02-13T01:21:42.495 INFO:teuthology.orchestra.run.trial126.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 534 kB/s | 37 kB 00:00 2026-02-13T01:21:42.593 INFO:teuthology.orchestra.run.trial126.stdout:(109/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 35 MB/s | 19 MB 00:00 2026-02-13T01:21:42.593 INFO:teuthology.orchestra.run.trial126.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 669 kB/s | 66 kB 00:00 2026-02-13T01:21:42.719 INFO:teuthology.orchestra.run.trial126.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 462 kB/s | 58 kB 00:00 2026-02-13T01:21:42.730 INFO:teuthology.orchestra.run.trial126.stdout:(112/173): socat-1.7.4.1-8.el9.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2026-02-13T01:21:42.820 INFO:teuthology.orchestra.run.trial126.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 705 kB/s | 64 kB 00:00 2026-02-13T01:21:42.878 INFO:teuthology.orchestra.run.trial154.stdout:(162/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 2.5 MB/s | 2.8 MB 00:01 2026-02-13T01:21:42.891 INFO:teuthology.orchestra.run.trial126.stdout:(114/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 558 kB/s | 96 kB 00:00 2026-02-13T01:21:42.912 INFO:teuthology.orchestra.run.trial126.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 490 kB/s | 45 kB 00:00 2026-02-13T01:21:42.947 INFO:teuthology.orchestra.run.trial154.stdout:(163/173): NetworkManager-1.54.3-2.el9.x86_64.r 34 MB/s | 2.4 MB 00:00 2026-02-13T01:21:42.962 INFO:teuthology.orchestra.run.trial154.stdout:(164/173): NetworkManager-libnm-1.54.3-2.el9.x8 127 MB/s | 1.9 MB 00:00 2026-02-13T01:21:42.967 INFO:teuthology.orchestra.run.trial154.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 7.0 MB/s | 37 kB 00:00 2026-02-13T01:21:42.970 INFO:teuthology.orchestra.run.trial126.stdout:(116/173): protobuf-compiler-3.14.0-17.el9.x86_ 15 MB/s | 862 kB 00:00 2026-02-13T01:21:42.974 INFO:teuthology.orchestra.run.trial154.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 37 MB/s | 248 kB 00:00 2026-02-13T01:21:42.982 INFO:teuthology.orchestra.run.trial154.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 106 MB/s | 866 kB 00:00 2026-02-13T01:21:42.983 INFO:teuthology.orchestra.run.trial126.stdout:(117/173): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2026-02-13T01:21:42.989 INFO:teuthology.orchestra.run.trial154.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 66 MB/s | 454 kB 00:00 2026-02-13T01:21:43.002 INFO:teuthology.orchestra.run.trial154.stdout:(169/173): openssl-3.5.5-1.el9.x86_64.rpm 121 MB/s | 1.5 MB 00:00 2026-02-13T01:21:43.009 INFO:teuthology.orchestra.run.trial154.stdout:(170/173): openssl-fips-provider-3.5.5-1.el9.x8 103 MB/s | 814 kB 00:00 2026-02-13T01:21:43.025 INFO:teuthology.orchestra.run.trial154.stdout:(171/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 144 MB/s | 2.3 MB 00:00 2026-02-13T01:21:43.163 INFO:teuthology.orchestra.run.trial126.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 2.8 MB/s | 551 kB 00:00 2026-02-13T01:21:43.179 INFO:teuthology.orchestra.run.trial126.stdout:(119/173): gperftools-libs-2.9.1-3.el9.x86_64.r 1.5 MB/s | 308 kB 00:00 2026-02-13T01:21:43.186 INFO:teuthology.orchestra.run.trial126.stdout:(120/173): grpc-data-1.46.7-10.el9.noarch.rpm 849 kB/s | 19 kB 00:00 2026-02-13T01:21:43.209 INFO:teuthology.orchestra.run.trial126.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.1 MB/s | 25 kB 00:00 2026-02-13T01:21:43.232 INFO:teuthology.orchestra.run.trial126.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2026-02-13T01:21:43.256 INFO:teuthology.orchestra.run.trial126.stdout:(123/173): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2026-02-13T01:21:43.271 INFO:teuthology.orchestra.run.trial154.stdout:(172/173): librados2-20.3.0-5241.g8f8d3829.el9. 2.2 MB/s | 3.5 MB 00:01 2026-02-13T01:21:43.283 INFO:teuthology.orchestra.run.trial126.stdout:(124/173): luarocks-3.9.2-5.el9.noarch.rpm 5.6 MB/s | 151 kB 00:00 2026-02-13T01:21:43.317 INFO:teuthology.orchestra.run.trial126.stdout:(125/173): libarrow-9.0.0-15.el9.x86_64.rpm 32 MB/s | 4.4 MB 00:00 2026-02-13T01:21:43.329 INFO:teuthology.orchestra.run.trial126.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 18 MB/s | 838 kB 00:00 2026-02-13T01:21:43.345 INFO:teuthology.orchestra.run.trial126.stdout:(127/173): python3-asyncssh-2.13.2-5.el9.noarch 19 MB/s | 548 kB 00:00 2026-02-13T01:21:43.352 INFO:teuthology.orchestra.run.trial126.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 1.3 MB/s | 29 kB 00:00 2026-02-13T01:21:43.371 INFO:teuthology.orchestra.run.trial126.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 2.3 MB/s | 60 kB 00:00 2026-02-13T01:21:43.375 INFO:teuthology.orchestra.run.trial126.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2026-02-13T01:21:43.397 INFO:teuthology.orchestra.run.trial126.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2026-02-13T01:21:43.398 INFO:teuthology.orchestra.run.trial126.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 619 kB/s | 14 kB 00:00 2026-02-13T01:21:43.423 INFO:teuthology.orchestra.run.trial126.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 6.5 MB/s | 173 kB 00:00 2026-02-13T01:21:43.424 INFO:teuthology.orchestra.run.trial126.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 13 MB/s | 358 kB 00:00 2026-02-13T01:21:43.449 INFO:teuthology.orchestra.run.trial126.stdout:(135/173): python3-google-auth-2.45.0-1.el9.noa 9.9 MB/s | 254 kB 00:00 2026-02-13T01:21:43.450 INFO:teuthology.orchestra.run.trial126.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 11 MB/s | 303 kB 00:00 2026-02-13T01:21:43.477 INFO:teuthology.orchestra.run.trial126.stdout:(137/173): python3-grpcio-tools-1.46.7-10.el9.x 5.4 MB/s | 144 kB 00:00 2026-02-13T01:21:43.497 INFO:teuthology.orchestra.run.trial126.stdout:(138/173): python3-grpcio-1.46.7-10.el9.x86_64. 43 MB/s | 2.0 MB 00:00 2026-02-13T01:21:43.503 INFO:teuthology.orchestra.run.trial126.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 416 kB/s | 11 kB 00:00 2026-02-13T01:21:43.521 INFO:teuthology.orchestra.run.trial126.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 763 kB/s | 18 kB 00:00 2026-02-13T01:21:43.529 INFO:teuthology.orchestra.run.trial126.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 892 kB/s | 23 kB 00:00 2026-02-13T01:21:43.544 INFO:teuthology.orchestra.run.trial126.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 864 kB/s | 20 kB 00:00 2026-02-13T01:21:43.554 INFO:teuthology.orchestra.run.trial126.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 756 kB/s | 19 kB 00:00 2026-02-13T01:21:43.567 INFO:teuthology.orchestra.run.trial126.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 1.1 MB/s | 26 kB 00:00 2026-02-13T01:21:43.585 INFO:teuthology.orchestra.run.trial126.stdout:(145/173): python3-kubernetes-26.1.0-3.el9.noar 33 MB/s | 1.0 MB 00:00 2026-02-13T01:21:43.590 INFO:teuthology.orchestra.run.trial126.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 3.3 MB/s | 79 kB 00:00 2026-02-13T01:21:43.611 INFO:teuthology.orchestra.run.trial126.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2026-02-13T01:21:43.613 INFO:teuthology.orchestra.run.trial126.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 724 kB/s | 16 kB 00:00 2026-02-13T01:21:43.636 INFO:teuthology.orchestra.run.trial126.stdout:(149/173): python3-pyperclip-1.8.2-2.el9.noarch 1.2 MB/s | 28 kB 00:00 2026-02-13T01:21:43.637 INFO:teuthology.orchestra.run.trial126.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.4 MB/s | 90 kB 00:00 2026-02-13T01:21:43.659 INFO:teuthology.orchestra.run.trial126.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 1.3 MB/s | 31 kB 00:00 2026-02-13T01:21:43.664 INFO:teuthology.orchestra.run.trial126.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 7.0 MB/s | 188 kB 00:00 2026-02-13T01:21:43.682 INFO:teuthology.orchestra.run.trial126.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2026-02-13T01:21:43.690 INFO:teuthology.orchestra.run.trial126.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2026-02-13T01:21:43.705 INFO:teuthology.orchestra.run.trial126.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 3.7 MB/s | 86 kB 00:00 2026-02-13T01:21:43.716 INFO:teuthology.orchestra.run.trial126.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 3.3 MB/s | 90 kB 00:00 2026-02-13T01:21:43.729 INFO:teuthology.orchestra.run.trial126.stdout:(157/173): python3-xmltodict-0.12.0-15.el9.noar 956 kB/s | 22 kB 00:00 2026-02-13T01:21:43.742 INFO:teuthology.orchestra.run.trial126.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 766 kB/s | 20 kB 00:00 2026-02-13T01:21:43.752 INFO:teuthology.orchestra.run.trial126.stdout:(159/173): re2-20211101-20.el9.x86_64.rpm 8.0 MB/s | 191 kB 00:00 2026-02-13T01:21:43.776 INFO:teuthology.orchestra.run.trial126.stdout:(160/173): thrift-0.15.0-4.el9.x86_64.rpm 47 MB/s | 1.6 MB 00:00 2026-02-13T01:21:43.777 INFO:teuthology.orchestra.run.trial126.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.9 MB/s | 122 kB 00:00 2026-02-13T01:21:44.918 INFO:teuthology.orchestra.run.trial126.stdout:(162/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 2.5 MB/s | 2.8 MB 00:01 2026-02-13T01:21:45.006 INFO:teuthology.orchestra.run.trial126.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 2.8 MB/s | 3.5 MB 00:01 2026-02-13T01:21:46.367 INFO:teuthology.orchestra.run.trial126.stdout:(164/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 3.0 MB/s | 78 MB 00:26 2026-02-13T01:21:46.850 INFO:teuthology.orchestra.run.trial126.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 77 kB/s | 37 kB 00:00 2026-02-13T01:21:47.246 INFO:teuthology.orchestra.run.trial126.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 625 kB/s | 248 kB 00:00 2026-02-13T01:21:47.646 INFO:teuthology.orchestra.run.trial126.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 2.1 MB/s | 866 kB 00:00 2026-02-13T01:21:47.693 INFO:teuthology.orchestra.run.trial126.stdout:(168/173): NetworkManager-1.54.3-2.el9.x86_64.r 877 kB/s | 2.4 MB 00:02 2026-02-13T01:21:47.745 INFO:teuthology.orchestra.run.trial154.stdout:(173/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 2.7 MB/s | 78 MB 00:29 2026-02-13T01:21:47.747 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:21:47.748 INFO:teuthology.orchestra.run.trial154.stdout:Total 7.4 MB/s | 302 MB 00:40 2026-02-13T01:21:47.806 INFO:teuthology.orchestra.run.trial126.stdout:(169/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 2.8 MB/s | 454 kB 00:00 2026-02-13T01:21:47.836 INFO:teuthology.orchestra.run.trial126.stdout:(170/173): NetworkManager-libnm-1.54.3-2.el9.x8 689 kB/s | 1.9 MB 00:02 2026-02-13T01:21:47.940 INFO:teuthology.orchestra.run.trial126.stdout:(171/173): openssl-3.5.5-1.el9.x86_64.rpm 6.0 MB/s | 1.5 MB 00:00 2026-02-13T01:21:47.968 INFO:teuthology.orchestra.run.trial126.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 4.9 MB/s | 814 kB 00:00 2026-02-13T01:21:48.511 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-13T01:21:48.582 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-13T01:21:48.583 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-13T01:21:49.673 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-13T01:21:49.673 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-13T01:21:50.599 INFO:teuthology.orchestra.run.trial126.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 854 kB/s | 2.3 MB 00:02 2026-02-13T01:21:50.604 INFO:teuthology.orchestra.run.trial126.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:21:50.604 INFO:teuthology.orchestra.run.trial126.stdout:Total 6.5 MB/s | 302 MB 00:46 2026-02-13T01:21:50.854 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-13T01:21:50.856 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:21:50.864 INFO:teuthology.orchestra.run.trial154.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:21:50.875 INFO:teuthology.orchestra.run.trial154.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:21:50.879 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:21:50.881 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:21:50.886 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:21:50.928 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:21:50.930 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:21:50.963 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:50.965 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:51.068 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:51.072 INFO:teuthology.orchestra.run.trial154.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:21:51.106 INFO:teuthology.orchestra.run.trial154.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:21:51.128 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:21:51.139 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:21:51.142 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:21:51.148 INFO:teuthology.orchestra.run.trial154.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:21:51.153 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:21:51.156 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:21:51.161 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:21:51.184 INFO:teuthology.orchestra.run.trial154.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:21:51.197 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:21:51.202 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:21:51.206 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:21:51.212 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:21:51.215 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:21:51.217 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:21:51.226 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:21:51.261 INFO:teuthology.orchestra.run.trial154.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:21:51.265 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:21:51.267 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:21:51.268 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:51.290 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:51.296 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:21:51.320 INFO:teuthology.orchestra.run.trial154.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:21:51.326 INFO:teuthology.orchestra.run.trial154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:21:51.328 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:21:51.331 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:21:51.334 INFO:teuthology.orchestra.run.trial154.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:21:51.339 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction check 2026-02-13T01:21:51.361 INFO:teuthology.orchestra.run.trial154.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:21:51.410 INFO:teuthology.orchestra.run.trial126.stdout:Transaction check succeeded. 2026-02-13T01:21:51.411 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction test 2026-02-13T01:21:51.413 INFO:teuthology.orchestra.run.trial154.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:21:51.425 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:21:51.431 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:21:51.440 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:21:51.457 INFO:teuthology.orchestra.run.trial154.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:21:51.463 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:21:51.622 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:21:51.626 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:51.762 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:51.763 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:51.813 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:51.814 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:51.842 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:51.844 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:21:51.852 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:21:51.857 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:21:51.917 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:21:51.932 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:21:51.939 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:21:51.940 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:51.961 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:51.962 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:51.990 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:51.997 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:21:52.006 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:21:52.018 INFO:teuthology.orchestra.run.trial154.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:21:52.075 INFO:teuthology.orchestra.run.trial154.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:21:52.105 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:21:52.111 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:21:52.115 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:21:52.129 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:21:52.133 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:21:52.139 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:21:52.150 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:21:52.155 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:21:52.164 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:21:52.168 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:21:52.176 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:21:52.216 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:21:52.506 INFO:teuthology.orchestra.run.trial126.stdout:Transaction test succeeded. 2026-02-13T01:21:52.506 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction 2026-02-13T01:21:52.542 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:21:52.552 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:21:52.556 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:21:52.562 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:21:52.567 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:21:52.572 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:21:52.575 INFO:teuthology.orchestra.run.trial154.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:21:52.576 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:21:52.605 INFO:teuthology.orchestra.run.trial154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:21:52.648 INFO:teuthology.orchestra.run.trial154.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:21:52.652 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:21:52.656 INFO:teuthology.orchestra.run.trial154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:21:52.662 INFO:teuthology.orchestra.run.trial154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:21:52.690 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:21:52.696 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:21:52.700 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:21:52.706 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:21:52.709 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:21:52.717 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:21:52.720 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:21:52.748 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:21:52.758 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:21:52.764 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:21:52.770 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:21:52.805 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:21:52.816 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:21:53.040 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:21:53.064 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:21:53.067 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:21:53.126 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:21:53.128 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:21:53.150 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:21:53.477 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:21:53.551 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:21:53.675 INFO:teuthology.orchestra.run.trial126.stdout: Preparing : 1/1 2026-02-13T01:21:53.678 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:21:53.686 INFO:teuthology.orchestra.run.trial126.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:21:53.698 INFO:teuthology.orchestra.run.trial126.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:21:53.702 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:21:53.704 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:21:53.708 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:21:53.752 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:21:53.755 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:21:53.796 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:53.798 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:53.900 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:53.903 INFO:teuthology.orchestra.run.trial126.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:21:53.939 INFO:teuthology.orchestra.run.trial126.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:21:53.961 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:21:53.972 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:21:53.976 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:21:53.981 INFO:teuthology.orchestra.run.trial126.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:21:53.986 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:21:53.989 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:21:53.994 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:21:54.017 INFO:teuthology.orchestra.run.trial126.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:21:54.030 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:21:54.036 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:21:54.040 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:21:54.046 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:21:54.048 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:21:54.049 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:21:54.059 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:21:54.094 INFO:teuthology.orchestra.run.trial126.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:21:54.099 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:21:54.101 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:21:54.101 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:54.123 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:54.130 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:21:54.153 INFO:teuthology.orchestra.run.trial126.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:21:54.160 INFO:teuthology.orchestra.run.trial126.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:21:54.162 INFO:teuthology.orchestra.run.trial126.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:21:54.165 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:21:54.167 INFO:teuthology.orchestra.run.trial126.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:21:54.196 INFO:teuthology.orchestra.run.trial126.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:21:54.225 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:21:54.241 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:21:54.244 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:21:54.246 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:21:54.247 INFO:teuthology.orchestra.run.trial126.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:21:54.253 INFO:teuthology.orchestra.run.trial154.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:21:54.260 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:21:54.265 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:21:54.274 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:21:54.292 INFO:teuthology.orchestra.run.trial126.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:21:54.298 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:21:54.449 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:21:54.454 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:54.540 INFO:teuthology.orchestra.run.trial154.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:21:54.542 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:54.559 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:54.560 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:21:54.587 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:54.588 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:54.636 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:54.637 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:54.666 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:54.668 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:21:54.676 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:21:54.679 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:21:54.741 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:21:54.756 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:21:54.764 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:21:54.764 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:54.786 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:54.786 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:54.813 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:54.820 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:21:54.828 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:21:54.841 INFO:teuthology.orchestra.run.trial126.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:21:54.898 INFO:teuthology.orchestra.run.trial126.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:21:54.927 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:21:54.933 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:21:54.937 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:21:54.951 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:21:54.956 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:21:54.961 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:21:54.962 INFO:teuthology.orchestra.run.trial091.stdout:(173/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 2.0 MB/s | 78 MB 00:38 2026-02-13T01:21:54.965 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:21:54.965 INFO:teuthology.orchestra.run.trial091.stdout:Total 5.8 MB/s | 302 MB 00:51 2026-02-13T01:21:54.972 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:21:54.977 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:21:54.986 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:21:54.990 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:21:54.998 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:21:55.038 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:21:55.363 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:21:55.372 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:21:55.377 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:21:55.382 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:21:55.385 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:21:55.391 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:21:55.393 INFO:teuthology.orchestra.run.trial126.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:21:55.395 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:21:55.424 INFO:teuthology.orchestra.run.trial126.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:21:55.467 INFO:teuthology.orchestra.run.trial126.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:21:55.471 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:21:55.474 INFO:teuthology.orchestra.run.trial126.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:21:55.481 INFO:teuthology.orchestra.run.trial126.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:21:55.509 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:21:55.515 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:21:55.518 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:21:55.524 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:21:55.528 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:21:55.535 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:21:55.538 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:21:55.566 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:21:55.576 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:21:55.582 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:21:55.589 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:21:55.624 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:21:55.634 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:21:55.714 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:55.717 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:55.717 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-13T01:21:55.735 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:55.750 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:21:55.766 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:21:55.786 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-13T01:21:55.787 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-13T01:21:55.842 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:21:55.850 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:21:55.858 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:21:55.874 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:21:55.882 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:21:55.886 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:21:55.904 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:21:55.945 INFO:teuthology.orchestra.run.trial126.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:21:55.947 INFO:teuthology.orchestra.run.trial126.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:21:55.954 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:21:55.960 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:21:55.964 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:21:55.968 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:21:55.968 INFO:teuthology.orchestra.run.trial154.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:21:55.971 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:21:55.972 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:55.988 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:56.245 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:21:56.249 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:56.290 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:56.291 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:21:56.291 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:21:56.291 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:21:56.294 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:21:56.295 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:21:56.369 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:21:56.886 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-13T01:21:56.886 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-13T01:21:57.044 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:21:57.059 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:21:57.063 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:21:57.065 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:21:57.071 INFO:teuthology.orchestra.run.trial126.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:21:57.354 INFO:teuthology.orchestra.run.trial126.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:21:57.355 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:57.376 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:21:57.377 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:21:58.055 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-13T01:21:58.058 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T01:21:58.066 INFO:teuthology.orchestra.run.trial091.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T01:21:58.079 INFO:teuthology.orchestra.run.trial091.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T01:21:58.083 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T01:21:58.084 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T01:21:58.089 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T01:21:58.132 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T01:21:58.134 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T01:21:58.179 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:58.181 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:58.283 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T01:21:58.286 INFO:teuthology.orchestra.run.trial091.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T01:21:58.319 INFO:teuthology.orchestra.run.trial091.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T01:21:58.341 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T01:21:58.352 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T01:21:58.356 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T01:21:58.361 INFO:teuthology.orchestra.run.trial091.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T01:21:58.366 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T01:21:58.369 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T01:21:58.373 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T01:21:58.397 INFO:teuthology.orchestra.run.trial091.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T01:21:58.410 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T01:21:58.416 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T01:21:58.419 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T01:21:58.425 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T01:21:58.427 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T01:21:58.428 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T01:21:58.438 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T01:21:58.473 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:58.473 INFO:teuthology.orchestra.run.trial091.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T01:21:58.475 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:58.478 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T01:21:58.480 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T01:21:58.481 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:58.494 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:21:58.502 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T01:21:58.508 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:21:58.509 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T01:21:58.524 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:21:58.533 INFO:teuthology.orchestra.run.trial091.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T01:21:58.538 INFO:teuthology.orchestra.run.trial091.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T01:21:58.540 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T01:21:58.543 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T01:21:58.546 INFO:teuthology.orchestra.run.trial091.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T01:21:58.574 INFO:teuthology.orchestra.run.trial091.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T01:21:58.600 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:21:58.609 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:21:58.626 INFO:teuthology.orchestra.run.trial091.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T01:21:58.632 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:21:58.639 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T01:21:58.645 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T01:21:58.652 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T01:21:58.662 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:21:58.670 INFO:teuthology.orchestra.run.trial091.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T01:21:58.677 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T01:21:58.713 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:21:58.719 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:21:58.722 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:21:58.728 INFO:teuthology.orchestra.run.trial126.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:21:58.730 INFO:teuthology.orchestra.run.trial126.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:21:58.731 INFO:teuthology.orchestra.run.trial126.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:58.749 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:21:58.834 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T01:21:58.837 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:58.977 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T01:21:58.979 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:59.001 INFO:teuthology.orchestra.run.trial126.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:21:59.004 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:59.029 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T01:21:59.030 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:59.042 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:21:59.043 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:21:59.043 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:21:59.043 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:21:59.046 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:21:59.056 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T01:21:59.058 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T01:21:59.066 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T01:21:59.070 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T01:21:59.130 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T01:21:59.143 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T01:21:59.151 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T01:21:59.152 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:59.172 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T01:21:59.173 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:59.201 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T01:21:59.209 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T01:21:59.217 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T01:21:59.229 INFO:teuthology.orchestra.run.trial091.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T01:21:59.285 INFO:teuthology.orchestra.run.trial091.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T01:21:59.315 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T01:21:59.321 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T01:21:59.324 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T01:21:59.338 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T01:21:59.343 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T01:21:59.348 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T01:21:59.359 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T01:21:59.364 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T01:21:59.373 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T01:21:59.377 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T01:21:59.385 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T01:21:59.425 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T01:21:59.751 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T01:21:59.761 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T01:21:59.765 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T01:21:59.771 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T01:21:59.774 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T01:21:59.780 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T01:21:59.782 INFO:teuthology.orchestra.run.trial091.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T01:21:59.783 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T01:21:59.812 INFO:teuthology.orchestra.run.trial091.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T01:21:59.855 INFO:teuthology.orchestra.run.trial091.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T01:21:59.859 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T01:21:59.862 INFO:teuthology.orchestra.run.trial091.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T01:21:59.869 INFO:teuthology.orchestra.run.trial091.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T01:21:59.897 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T01:21:59.903 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T01:21:59.906 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T01:21:59.912 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T01:21:59.916 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T01:21:59.923 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T01:21:59.926 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T01:21:59.955 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T01:21:59.964 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T01:21:59.970 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T01:21:59.977 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T01:22:00.012 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:22:00.022 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T01:22:00.246 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T01:22:00.270 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T01:22:00.274 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T01:22:00.332 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T01:22:00.334 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T01:22:00.355 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T01:22:00.683 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T01:22:00.757 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T01:22:00.993 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:00.993 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /sys 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /proc 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /mnt 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /var/tmp 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /home 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /root 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /tmp 2026-02-13T01:22:00.994 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:01.097 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:01.119 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:01.120 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:01.120 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:22:01.120 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:01.120 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:01.120 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:01.343 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:01.364 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:01.364 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:01.364 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:22:01.364 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:01.365 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:01.365 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:01.370 INFO:teuthology.orchestra.run.trial154.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:22:01.372 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:22:01.389 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:01.390 INFO:teuthology.orchestra.run.trial154.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:22:01.390 INFO:teuthology.orchestra.run.trial154.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:22:01.390 INFO:teuthology.orchestra.run.trial154.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:22:01.390 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:01.397 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:01.421 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:01.421 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:22:01.421 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:01.432 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T01:22:01.447 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T01:22:01.450 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T01:22:01.453 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T01:22:01.457 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:22:01.458 INFO:teuthology.orchestra.run.trial091.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T01:22:01.749 INFO:teuthology.orchestra.run.trial091.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T01:22:01.750 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:22:01.769 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T01:22:01.770 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T01:22:02.111 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:22:02.897 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:22:02.926 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:22:02.928 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:22:02.947 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T01:22:02.960 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:22:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T01:22:02.962 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:02.976 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:02.976 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:02.976 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:22:02.976 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:02.977 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T01:22:02.987 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:03.011 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:03.011 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:03.011 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:22:03.012 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:03.012 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:03.012 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:03.053 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T01:22:03.061 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T01:22:03.073 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:03.075 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:03.084 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:22:03.085 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T01:22:03.108 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:22:03.110 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:03.115 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T01:22:03.166 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T01:22:03.172 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T01:22:03.176 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T01:22:03.180 INFO:teuthology.orchestra.run.trial091.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T01:22:03.182 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T01:22:03.183 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:22:03.199 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T01:22:03.457 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T01:22:03.460 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:22:03.498 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T01:22:03.498 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T01:22:03.498 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T01:22:03.498 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:03.501 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /sys 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /proc 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /mnt 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /var/tmp 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /home 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /root 2026-02-13T01:22:03.749 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /tmp 2026-02-13T01:22:03.750 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:03.852 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:03.874 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:03.874 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:03.875 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:22:03.875 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:03.875 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:03.875 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:04.088 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:04.109 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:04.109 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:04.109 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:22:04.109 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:04.109 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:04.109 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:04.116 INFO:teuthology.orchestra.run.trial126.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:22:04.117 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:22:04.135 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:04.135 INFO:teuthology.orchestra.run.trial126.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:22:04.135 INFO:teuthology.orchestra.run.trial126.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:22:04.135 INFO:teuthology.orchestra.run.trial126.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:22:04.136 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:04.143 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:04.167 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:04.167 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:22:04.167 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:04.202 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:22:04.699 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:04.706 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:04.823 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:22:05.173 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:05.174 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:05.234 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:05.276 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:22:05.277 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:05.297 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:05.297 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.297 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:22:05.297 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:05.297 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:05.297 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:05.308 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:05.319 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:05.579 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:22:05.641 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:22:05.643 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:05.657 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:05.657 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.658 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:22:05.658 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:05.668 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:05.691 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:05.691 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.691 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:22:05.691 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:05.691 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:05.692 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:05.751 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:05.753 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:05.763 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:22:05.787 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:22:05.788 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:05.923 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:22:05.925 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:05.947 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:05.947 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.947 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:22:05.948 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:05.948 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:05.948 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:05.956 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:05.976 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:05.976 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:05.976 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:22:05.976 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:05.989 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:06.010 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:06.010 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:06.010 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:22:06.010 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:06.010 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:06.010 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:06.142 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:06.162 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:06.162 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:06.162 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:22:06.162 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:06.162 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:06.163 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:07.351 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:07.358 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:07.813 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:07.814 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:07.875 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:07.916 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:22:07.917 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:07.937 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:07.937 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:07.937 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:22:07.937 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:07.937 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:07.938 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:07.948 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:07.958 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /sys 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /proc 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /mnt 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /var/tmp 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /home 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /root 2026-02-13T01:22:08.089 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /tmp 2026-02-13T01:22:08.090 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:08.193 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:08.216 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T01:22:08.216 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:08.216 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T01:22:08.216 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:08.216 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T01:22:08.217 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:08.434 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:08.455 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T01:22:08.455 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:08.455 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T01:22:08.455 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:08.455 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T01:22:08.455 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:08.460 INFO:teuthology.orchestra.run.trial091.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T01:22:08.462 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T01:22:08.479 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:08.479 INFO:teuthology.orchestra.run.trial091.stdout:Creating group 'qat' with GID 992. 2026-02-13T01:22:08.479 INFO:teuthology.orchestra.run.trial091.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T01:22:08.479 INFO:teuthology.orchestra.run.trial091.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T01:22:08.479 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:08.488 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:08.512 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T01:22:08.512 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T01:22:08.512 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:08.533 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:22:08.535 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:08.549 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T01:22:08.557 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:08.557 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:08.557 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:22:08.557 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:08.557 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:08.557 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:08.566 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:08.585 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:08.585 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:08.585 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:22:08.586 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:08.599 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:08.619 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:08.619 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:08.619 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:22:08.619 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:08.619 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:08.620 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:08.743 INFO:teuthology.orchestra.run.trial126.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:08.763 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:08.763 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:08.763 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:22:08.763 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:08.763 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:08.763 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:09.194 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T01:22:09.743 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:22:09.757 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:22:09.760 INFO:teuthology.orchestra.run.trial154.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:22:09.833 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:22:09.851 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:22:09.856 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:22:09.857 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:22:09.978 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:09.982 INFO:teuthology.orchestra.run.trial154.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:09.990 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T01:22:10.000 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:10.004 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:22:10.013 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:22:10.053 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T01:22:10.055 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:10.058 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:10.069 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T01:22:10.069 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:10.070 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T01:22:10.070 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:10.079 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:10.102 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T01:22:10.102 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:10.102 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T01:22:10.102 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:10.102 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T01:22:10.102 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:10.161 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:10.163 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T01:22:10.173 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T01:22:10.197 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T01:22:10.198 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:10.497 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:22:10.521 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:22:10.523 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:22:10.526 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:10.528 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:22:10.537 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:22:10.563 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:22:10.566 INFO:teuthology.orchestra.run.trial154.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:22:10.568 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:10.572 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:22:10.572 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:10.585 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:10.585 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:10.597 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:10.598 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:22:10.600 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:22:10.601 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:22:10.607 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:10.607 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:10.698 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:10.701 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:22:10.704 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:22:10.705 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:10.711 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:22:10.718 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:10.742 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:11.684 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:22:11.685 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:22:11.686 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:22:11.687 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:22:11.688 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:22:11.689 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:22:11.690 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:22:11.691 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:22:11.692 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:22:11.693 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:22:11.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:22:11.695 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:22:11.696 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:22:11.697 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:22:11.698 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:22:11.699 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:22:11.699 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:22:11.699 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:22:11.699 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:22:11.699 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:22:11.755 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:11.755 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout:Upgraded: 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:11.756 INFO:teuthology.orchestra.run.trial154.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.757 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.758 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:22:11.759 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.760 INFO:teuthology.orchestra.run.trial154.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:22:11.761 INFO:teuthology.orchestra.run.trial154.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:22:11.762 INFO:teuthology.orchestra.run.trial154.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:22:11.763 INFO:teuthology.orchestra.run.trial154.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:22:11.764 INFO:teuthology.orchestra.run.trial154.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:22:11.765 INFO:teuthology.orchestra.run.trial154.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:22:11.766 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:22:11.767 INFO:teuthology.orchestra.run.trial154.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.768 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:22:11.769 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-13T01:22:11.797 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T01:22:11.804 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:11.850 DEBUG:teuthology.parallel:result is None 2026-02-13T01:22:12.186 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:22:12.200 INFO:teuthology.orchestra.run.trial126.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:22:12.203 INFO:teuthology.orchestra.run.trial126.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:22:12.274 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T01:22:12.275 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:12.277 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:22:12.296 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:22:12.301 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:22:12.302 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:22:12.338 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T01:22:12.380 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T01:22:12.381 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:12.402 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T01:22:12.402 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:12.402 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T01:22:12.403 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:12.403 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T01:22:12.403 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:12.414 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:12.423 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T01:22:12.424 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:12.427 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:12.445 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:12.449 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:22:12.458 INFO:teuthology.orchestra.run.trial126.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:22:12.501 INFO:teuthology.orchestra.run.trial126.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:12.950 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:22:12.975 INFO:teuthology.orchestra.run.trial126.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:22:12.976 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:22:12.980 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:12.981 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:22:12.990 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:22:13.017 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:22:13.020 INFO:teuthology.orchestra.run.trial126.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:22:13.022 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:13.023 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T01:22:13.025 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:13.025 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:22:13.026 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:13.038 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:13.038 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:13.046 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T01:22:13.046 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:13.046 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T01:22:13.046 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:13.046 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T01:22:13.046 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:13.050 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:13.052 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:22:13.054 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:22:13.055 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:13.055 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:22:13.061 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:13.061 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:13.074 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T01:22:13.074 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:13.074 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T01:22:13.074 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:13.087 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:13.107 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T01:22:13.107 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:13.107 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T01:22:13.107 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:13.107 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T01:22:13.107 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:13.155 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:13.158 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:22:13.161 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:22:13.162 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:13.168 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:22:13.174 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:13.199 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:13.238 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:13.258 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T01:22:13.258 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T01:22:13.258 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T01:22:13.258 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:13.258 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T01:22:13.258 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:14.137 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:22:14.138 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:22:14.139 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:22:14.140 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:22:14.141 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:22:14.219 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:14.219 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:14.219 INFO:teuthology.orchestra.run.trial126.stdout:Upgraded: 2026-02-13T01:22:14.219 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:14.219 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:14.219 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout:Installed: 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:22:14.220 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:22:14.221 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:22:14.222 INFO:teuthology.orchestra.run.trial126.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:22:14.223 INFO:teuthology.orchestra.run.trial126.stdout:Complete! 2026-02-13T01:22:14.318 DEBUG:teuthology.parallel:result is None 2026-02-13T01:22:16.844 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T01:22:16.858 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T01:22:16.861 INFO:teuthology.orchestra.run.trial091.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T01:22:16.935 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T01:22:16.954 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T01:22:16.958 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T01:22:16.960 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T01:22:17.080 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:17.084 INFO:teuthology.orchestra.run.trial091.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:17.101 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T01:22:17.106 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T01:22:17.116 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T01:22:17.162 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:17.616 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T01:22:17.640 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T01:22:17.642 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T01:22:17.645 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:17.646 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T01:22:17.656 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T01:22:17.683 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T01:22:17.685 INFO:teuthology.orchestra.run.trial091.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T01:22:17.687 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:17.691 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T01:22:17.691 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:17.703 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T01:22:17.703 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:17.716 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T01:22:17.717 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T01:22:17.719 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T01:22:17.720 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T01:22:17.726 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:17.726 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:17.817 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T01:22:17.819 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T01:22:17.822 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T01:22:17.824 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:17.829 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T01:22:17.836 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:17.860 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T01:22:18.812 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:18.812 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T01:22:18.812 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T01:22:18.812 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T01:22:18.812 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T01:22:18.812 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T01:22:18.813 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T01:22:18.814 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T01:22:18.815 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T01:22:18.816 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T01:22:18.817 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T01:22:18.818 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T01:22:18.819 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T01:22:18.820 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T01:22:18.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T01:22:18.822 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T01:22:18.823 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T01:22:18.824 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T01:22:18.825 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T01:22:18.826 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T01:22:18.881 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout:Upgraded: 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T01:22:18.882 INFO:teuthology.orchestra.run.trial091.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.883 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.884 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T01:22:18.885 INFO:teuthology.orchestra.run.trial091.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T01:22:18.886 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.887 INFO:teuthology.orchestra.run.trial091.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T01:22:18.888 INFO:teuthology.orchestra.run.trial091.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T01:22:18.889 INFO:teuthology.orchestra.run.trial091.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.890 INFO:teuthology.orchestra.run.trial091.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T01:22:18.891 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:18.892 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T01:22:18.893 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T01:22:18.894 INFO:teuthology.orchestra.run.trial091.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T01:22:18.895 INFO:teuthology.orchestra.run.trial091.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T01:22:18.896 INFO:teuthology.orchestra.run.trial091.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T01:22:18.896 INFO:teuthology.orchestra.run.trial091.stdout: zip-3.0-35.el9.x86_64 2026-02-13T01:22:18.896 INFO:teuthology.orchestra.run.trial091.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T01:22:18.896 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:18.896 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-13T01:22:18.982 DEBUG:teuthology.parallel:result is None 2026-02-13T01:22:18.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:19.144 DEBUG:teuthology.orchestra.run.trial091:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:22:19.166 INFO:teuthology.orchestra.run.trial091.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:19.166 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:19.167 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:22:19.170 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:19.330 DEBUG:teuthology.orchestra.run.trial126:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:22:19.353 INFO:teuthology.orchestra.run.trial126.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:19.353 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:19.353 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:22:19.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:19.514 DEBUG:teuthology.orchestra.run.trial154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T01:22:19.536 INFO:teuthology.orchestra.run.trial154.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:19.537 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T01:22:19.537 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T01:22:19.539 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T01:22:19.540 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:19.540 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:22:19.568 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:22:19.568 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:22:19.597 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:22:19.598 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T01:22:19.625 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T01:22:19.625 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:19.625 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:22:19.650 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:22:19.716 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:22:19.716 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:22:19.742 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:22:19.807 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:22:19.807 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T01:22:19.833 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T01:22:19.897 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T01:22:19.897 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:19.897 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:22:19.922 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:22:19.988 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:22:19.988 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:22:20.014 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:22:20.078 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:22:20.078 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T01:22:20.104 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T01:22:20.169 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T01:22:20.169 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:20.169 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:22:20.195 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:22:20.260 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:22:20.260 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:22:20.286 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:22:20.350 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:22:20.350 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T01:22:20.376 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T01:22:20.440 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T01:22:20.567 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds use global snaprealm seq for subvol': False, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2026-02-13T01:22:20.567 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:22:20.569 INFO:tasks.cephadm:Cluster fsid is 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:20.569 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T01:22:20.569 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.91', 'mon.b': '10.20.193.126', 'mon.c': '10.20.193.154'} 2026-02-13T01:22:20.569 INFO:tasks.cephadm:First mon is mon.a on trial091 2026-02-13T01:22:20.569 INFO:tasks.cephadm:First mgr is x 2026-02-13T01:22:20.570 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T01:22:20.570 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname $(hostname -s) 2026-02-13T01:22:20.594 DEBUG:teuthology.orchestra.run.trial126:> sudo hostname $(hostname -s) 2026-02-13T01:22:20.621 DEBUG:teuthology.orchestra.run.trial154:> sudo hostname $(hostname -s) 2026-02-13T01:22:20.647 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T01:22:20.647 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:20.800 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T01:22:20.931 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T01:22:20.933 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T01:22:20.933 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T01:22:20.933 DEBUG:teuthology.orchestra.run.trial091:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.230 INFO:teuthology.orchestra.run.trial091.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:22 /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.231 DEBUG:teuthology.orchestra.run.trial126:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.545 INFO:teuthology.orchestra.run.trial126.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:22 /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.546 DEBUG:teuthology.orchestra.run.trial154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.860 INFO:teuthology.orchestra.run.trial154.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 01:22 /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.861 DEBUG:teuthology.orchestra.run.trial091:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.880 DEBUG:teuthology.orchestra.run.trial126:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.900 DEBUG:teuthology.orchestra.run.trial154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T01:22:21.944 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T01:22:21.944 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:22:21.946 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:22:21.949 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T01:22:22.102 INFO:teuthology.orchestra.run.trial126.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:22.111 INFO:teuthology.orchestra.run.trial154.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:22.113 INFO:teuthology.orchestra.run.trial091.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:36.040 INFO:teuthology.orchestra.run.trial126.stdout:{ 2026-02-13T01:22:36.041 INFO:teuthology.orchestra.run.trial126.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:22:36.041 INFO:teuthology.orchestra.run.trial126.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:22:36.041 INFO:teuthology.orchestra.run.trial126.stdout: "repo_digests": [ 2026-02-13T01:22:36.041 INFO:teuthology.orchestra.run.trial126.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:22:36.041 INFO:teuthology.orchestra.run.trial126.stdout: ] 2026-02-13T01:22:36.041 INFO:teuthology.orchestra.run.trial126.stdout:} 2026-02-13T01:22:39.455 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-13T01:22:39.456 INFO:teuthology.orchestra.run.trial091.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:22:39.456 INFO:teuthology.orchestra.run.trial091.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:22:39.456 INFO:teuthology.orchestra.run.trial091.stdout: "repo_digests": [ 2026-02-13T01:22:39.456 INFO:teuthology.orchestra.run.trial091.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:22:39.456 INFO:teuthology.orchestra.run.trial091.stdout: ] 2026-02-13T01:22:39.456 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-13T01:22:40.237 INFO:teuthology.orchestra.run.trial154.stdout:{ 2026-02-13T01:22:40.238 INFO:teuthology.orchestra.run.trial154.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T01:22:40.238 INFO:teuthology.orchestra.run.trial154.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T01:22:40.238 INFO:teuthology.orchestra.run.trial154.stdout: "repo_digests": [ 2026-02-13T01:22:40.238 INFO:teuthology.orchestra.run.trial154.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T01:22:40.238 INFO:teuthology.orchestra.run.trial154.stdout: ] 2026-02-13T01:22:40.238 INFO:teuthology.orchestra.run.trial154.stdout:} 2026-02-13T01:22:40.256 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /etc/ceph 2026-02-13T01:22:40.284 DEBUG:teuthology.orchestra.run.trial126:> sudo mkdir -p /etc/ceph 2026-02-13T01:22:40.314 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /etc/ceph 2026-02-13T01:22:40.353 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 777 /etc/ceph 2026-02-13T01:22:40.380 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod 777 /etc/ceph 2026-02-13T01:22:40.406 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod 777 /etc/ceph 2026-02-13T01:22:40.432 INFO:tasks.cephadm:Writing seed config... 2026-02-13T01:22:40.434 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T01:22:40.434 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-13T01:22:40.435 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T01:22:40.436 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-13T01:22:40.437 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:40.438 DEBUG:teuthology.orchestra.run.trial091:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T01:22:40.454 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7155d718-087a-11f1-982a-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.2 2026-02-13T01:22:40.454 DEBUG:teuthology.orchestra.run.trial091:mon.a> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a.service 2026-02-13T01:22:40.497 DEBUG:teuthology.orchestra.run.trial091:mgr.x> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x.service 2026-02-13T01:22:40.539 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T01:22:40.540 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.91 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:40.680 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-13T01:22:40.680 INFO:teuthology.orchestra.run.trial091.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.91', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T01:22:40.680 INFO:teuthology.orchestra.run.trial091.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T01:22:40.681 INFO:teuthology.orchestra.run.trial091.stdout:Verifying podman|docker is present... 2026-02-13T01:22:40.696 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stdout 5.6.0 2026-02-13T01:22:40.696 INFO:teuthology.orchestra.run.trial091.stdout:Verifying lvm2 is present... 2026-02-13T01:22:40.696 INFO:teuthology.orchestra.run.trial091.stdout:Verifying time synchronization is in place... 2026-02-13T01:22:40.703 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T01:22:40.703 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T01:22:40.709 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T01:22:40.709 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout inactive 2026-02-13T01:22:40.716 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout enabled 2026-02-13T01:22:40.721 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout active 2026-02-13T01:22:40.721 INFO:teuthology.orchestra.run.trial091.stdout:Unit chronyd.service is enabled and running 2026-02-13T01:22:40.722 INFO:teuthology.orchestra.run.trial091.stdout:Repeating the final host check... 2026-02-13T01:22:40.737 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stdout 5.6.0 2026-02-13T01:22:40.737 INFO:teuthology.orchestra.run.trial091.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T01:22:40.738 INFO:teuthology.orchestra.run.trial091.stdout:systemctl is present 2026-02-13T01:22:40.738 INFO:teuthology.orchestra.run.trial091.stdout:lvcreate is present 2026-02-13T01:22:40.743 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T01:22:40.743 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T01:22:40.749 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T01:22:40.749 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout inactive 2026-02-13T01:22:40.754 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout enabled 2026-02-13T01:22:40.760 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout active 2026-02-13T01:22:40.760 INFO:teuthology.orchestra.run.trial091.stdout:Unit chronyd.service is enabled and running 2026-02-13T01:22:40.760 INFO:teuthology.orchestra.run.trial091.stdout:Host looks OK 2026-02-13T01:22:40.760 INFO:teuthology.orchestra.run.trial091.stdout:Cluster fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:40.760 INFO:teuthology.orchestra.run.trial091.stdout:Acquiring lock 140294892211696 on /run/cephadm/7155d718-087a-11f1-982a-d404e6e7d460.lock 2026-02-13T01:22:40.761 INFO:teuthology.orchestra.run.trial091.stdout:Lock 140294892211696 acquired on /run/cephadm/7155d718-087a-11f1-982a-d404e6e7d460.lock 2026-02-13T01:22:40.761 INFO:teuthology.orchestra.run.trial091.stdout:Verifying IP 10.20.193.91 port 3300 ... 2026-02-13T01:22:40.761 INFO:teuthology.orchestra.run.trial091.stdout:Verifying IP 10.20.193.91 port 6789 ... 2026-02-13T01:22:40.761 INFO:teuthology.orchestra.run.trial091.stdout:Base mon IP(s) is [10.20.193.91:3300, 10.20.193.91:6789], mon addrv is [v2:10.20.193.91:3300,v1:10.20.193.91:6789] 2026-02-13T01:22:40.764 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.91 metric 102 2026-02-13T01:22:40.764 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.91 metric 102 2026-02-13T01:22:40.764 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-13T01:22:40.766 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T01:22:40.767 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-13T01:22:40.767 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-13T01:22:40.770 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T01:22:40.770 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T01:22:40.770 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:22:40.770 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout inet6 fe80::768:c75d:cc21:cd50/64 scope link noprefixroute 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:6292/64 scope link 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:Mon IP `10.20.193.91` is in CIDR network `10.20.192.0/20` 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:Mon IP `10.20.193.91` is in CIDR network `10.20.192.0/20` 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T01:22:40.771 INFO:teuthology.orchestra.run.trial091.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T01:22:40.772 INFO:teuthology.orchestra.run.trial091.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:41.037 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T01:22:41.037 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T01:22:41.037 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T01:22:41.038 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T01:22:41.038 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T01:22:41.038 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T01:22:41.038 INFO:teuthology.orchestra.run.trial091.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T01:22:41.163 INFO:teuthology.orchestra.run.trial091.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T01:22:41.163 INFO:teuthology.orchestra.run.trial091.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T01:22:41.164 INFO:teuthology.orchestra.run.trial091.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T01:22:41.312 INFO:teuthology.orchestra.run.trial091.stdout:stat: stdout 167 167 2026-02-13T01:22:41.312 INFO:teuthology.orchestra.run.trial091.stdout:Creating initial keys... 2026-02-13T01:22:41.419 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph-authtool: stdout AQDhfI5pAF9YGBAA1IKHt+s4a5z2W9K0i8u+kg== 2026-02-13T01:22:41.531 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph-authtool: stdout AQDhfI5pjgUGHxAAZQf3gpr93gwU8FFZknylPg== 2026-02-13T01:22:41.653 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph-authtool: stdout AQDhfI5pu/SuJRAAa5gsJmXSm4ZpqCcYX7t9vQ== 2026-02-13T01:22:41.654 INFO:teuthology.orchestra.run.trial091.stdout:Creating initial monmap... 2026-02-13T01:22:41.770 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T01:22:41.770 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T01:22:41.770 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:41.770 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T01:22:41.770 INFO:teuthology.orchestra.run.trial091.stdout:monmaptool for a [v2:10.20.193.91:3300,v1:10.20.193.91:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T01:22:41.770 INFO:teuthology.orchestra.run.trial091.stdout:setting min_mon_release = tentacle 2026-02-13T01:22:41.771 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/monmaptool: set fsid to 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:41.771 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T01:22:41.771 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:41.771 INFO:teuthology.orchestra.run.trial091.stdout:Creating mon... 2026-02-13T01:22:41.909 INFO:teuthology.orchestra.run.trial091.stdout:create mon.a on 2026-02-13T01:22:42.072 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T01:22:42.172 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T01:22:42.276 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7155d718-087a-11f1-982a-d404e6e7d460.target → /etc/systemd/system/ceph-7155d718-087a-11f1-982a-d404e6e7d460.target. 2026-02-13T01:22:42.276 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7155d718-087a-11f1-982a-d404e6e7d460.target → /etc/systemd/system/ceph-7155d718-087a-11f1-982a-d404e6e7d460.target. 2026-02-13T01:22:42.400 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a 2026-02-13T01:22:42.401 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a.service: Unit ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a.service not loaded. 2026-02-13T01:22:42.518 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7155d718-087a-11f1-982a-d404e6e7d460.target.wants/ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-7155d718-087a-11f1-982a-d404e6e7d460@.service. 2026-02-13T01:22:42.658 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:22:42.658 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout disabled 2026-02-13T01:22:42.664 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:22:42.664 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout inactive 2026-02-13T01:22:42.664 INFO:teuthology.orchestra.run.trial091.stdout:firewalld.service is not enabled 2026-02-13T01:22:42.664 INFO:teuthology.orchestra.run.trial091.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T01:22:42.665 INFO:teuthology.orchestra.run.trial091.stdout:Waiting for mon to start... 2026-02-13T01:22:42.665 INFO:teuthology.orchestra.run.trial091.stdout:Waiting for mon... 2026-02-13T01:22:42.667 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:42 trial091 systemd[1]: Started Ceph mon.a for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:22:42.830 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout id: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout services: 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.144164s) [leader: a] 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout data: 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T01:22:42.831 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T01:22:42.832 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T01:22:42.832 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.832 INFO:teuthology.orchestra.run.trial091.stdout:mon is available 2026-02-13T01:22:42.832 INFO:teuthology.orchestra.run.trial091.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T01:22:42.945 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:42 trial091 ceph-mon[24639]: mkfs 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:42.945 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:42 trial091 ceph-mon[24639]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:22:42.998 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:42.998 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout fsid = 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.91:3300,v1:10.20.193.91:6789] 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T01:22:42.999 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T01:22:43.000 INFO:teuthology.orchestra.run.trial091.stdout:Generating new minimal ceph.conf... 2026-02-13T01:22:43.167 INFO:teuthology.orchestra.run.trial091.stdout:Restarting the monitor... 2026-02-13T01:22:43.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 systemd[1]: Stopping Ceph mon.a for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a[24635]: 2026-02-13T01:22:43.250+0000 7f79b87bd6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a[24635]: 2026-02-13T01:22:43.250+0000 7f79b87bd6c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 podman[24919]: 2026-02-13 01:22:43.371664513 +0000 UTC m=+0.133885495 container died c0cd912bb63a9d950a4fcfc201bc9439a01e5f08416935a50d9ed927621f1a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, ceph=True, vendor=Rocky Enterprise Software Foundation, version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7) 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 podman[24919]: 2026-02-13 01:22:43.379948166 +0000 UTC m=+0.142169138 container remove c0cd912bb63a9d950a4fcfc201bc9439a01e5f08416935a50d9ed927621f1a5d (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 bash[24919]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 systemd[1]: ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T01:22:43.528 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 systemd[1]: Stopped Ceph mon.a for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:22:43.529 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 systemd[1]: Starting Ceph mon.a for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:22:43.562 INFO:teuthology.orchestra.run.trial091.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T01:22:43.730 INFO:teuthology.orchestra.run.trial091.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T01:22:43.730 INFO:teuthology.orchestra.run.trial091.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:43.730 INFO:teuthology.orchestra.run.trial091.stdout:Creating mgr... 2026-02-13T01:22:43.731 INFO:teuthology.orchestra.run.trial091.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T01:22:43.731 INFO:teuthology.orchestra.run.trial091.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T01:22:43.855 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x 2026-02-13T01:22:43.855 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x.service: Unit ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T01:22:43.861 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 podman[25039]: 2026-02-13 01:22:43.529423683 +0000 UTC m=+0.016745089 container create 106bb0db0b2ffd1b5270041d49b05943b882c663d4fe7ec60cb5feafde01d84f (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, io.buildah.version=1.33.7, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, OSD_FLAVOR=default, version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:22:43.862 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 podman[25039]: 2026-02-13 01:22:43.553239367 +0000 UTC m=+0.040560763 container init 106bb0db0b2ffd1b5270041d49b05943b882c663d4fe7ec60cb5feafde01d84f (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, version=10, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:22:43.862 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 podman[25039]: 2026-02-13 01:22:43.555509871 +0000 UTC m=+0.042831277 container start 106bb0db0b2ffd1b5270041d49b05943b882c663d4fe7ec60cb5feafde01d84f (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, summary=Rocky Linux Base image, ceph=True) 2026-02-13T01:22:43.862 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 bash[25039]: 106bb0db0b2ffd1b5270041d49b05943b882c663d4fe7ec60cb5feafde01d84f 2026-02-13T01:22:43.863 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 podman[25039]: 2026-02-13 01:22:43.52262182 +0000 UTC m=+0.009943226 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 systemd[1]: Started Ceph mon.a for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: pidfile_write: ignore empty --pid-file 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: load: jerasure load: lrc 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: RocksDB version: 7.9.2 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Git sha 0 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: DB SUMMARY 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: DB Session ID: JPY52W19V4IR93ENVK9K 2026-02-13T01:22:43.864 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: CURRENT file: CURRENT 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 83361 ; 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.error_if_exists: 0 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.create_if_missing: 0 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.paranoid_checks: 1 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.env: 0x56527377b2c0 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T01:22:43.865 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.info_log: 0x565274b1cd60 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.statistics: (nil) 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.use_fsync: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_log_file_size: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.allow_fallocate: 1 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.use_direct_reads: 0 2026-02-13T01:22:43.866 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.db_log_dir: 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.wal_dir: 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.write_buffer_manager: 0x565274b13b80 2026-02-13T01:22:43.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.unordered_write: 0 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T01:22:43.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.row_cache: None 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.wal_filter: None 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.two_write_queues: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.wal_compression: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.atomic_flush: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.log_readahead_size: 0 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T01:22:43.869 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_background_jobs: 2 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_background_compactions: -1 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_subcompactions: 1 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T01:22:43.870 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_open_files: -1 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_background_flushes: -1 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Compression algorithms supported: 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kZSTD supported: 0 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kXpressCompression supported: 0 2026-02-13T01:22:43.871 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kBZip2Compression supported: 0 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kLZ4Compression supported: 1 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kZlibCompression supported: 1 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: kSnappyCompression supported: 1 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.merge_operator: 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_filter: None 2026-02-13T01:22:43.872 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x565274c9c360) 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: cache_index_and_filter_blocks: 1 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: pin_top_level_index_and_filter: 1 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: index_type: 0 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: data_block_index_type: 0 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: index_shortening: 1 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T01:22:43.873 INFO:journalctl@ceph.mon.a.trial091.stdout: checksum: 4 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: no_block_cache: 0 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_cache: 0x565274b15690 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_cache_name: BinnedLRUCache 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_cache_options: 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: capacity : 536870912 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: num_shard_bits : 4 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: strict_capacity_limit : 0 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: high_pri_pool_ratio: 0.000 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_cache_compressed: (nil) 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: persistent_cache: (nil) 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_size: 4096 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_size_deviation: 10 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: block_restart_interval: 16 2026-02-13T01:22:43.874 INFO:journalctl@ceph.mon.a.trial091.stdout: index_block_restart_interval: 1 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: metadata_block_size: 4096 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: partition_filters: 0 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: use_delta_encoding: 1 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: filter_policy: bloomfilter 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: whole_key_filtering: 1 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: verify_compression: 0 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: read_amp_bytes_per_bit: 0 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: format_version: 5 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: enable_index_compression: 1 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: block_align: 0 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: max_auto_readahead_size: 262144 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: prepopulate_block_cache: 0 2026-02-13T01:22:43.875 INFO:journalctl@ceph.mon.a.trial091.stdout: initial_auto_readahead_size: 8192 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression: NoCompression 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.num_levels: 7 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T01:22:43.876 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T01:22:43.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T01:22:43.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T01:22:43.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.inplace_update_support: 0 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T01:22:43.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.bloom_locality: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.max_successive_merges: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.ttl: 2592000 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.enable_blob_files: false 2026-02-13T01:22:43.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.min_blob_size: 0 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 68716aeb-3b04-42c4-803d-84cf451113d0 2026-02-13T01:22:43.882 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945763570225, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945763571402, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 79897, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 255, "table_properties": {"data_size": 78074, "index_size": 208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11388, "raw_average_key_size": 50, "raw_value_size": 71667, "raw_average_value_size": 317, "num_data_blocks": 9, "num_entries": 226, "num_filter_entries": 226, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770945763, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "68716aeb-3b04-42c4-803d-84cf451113d0", "db_session_id": "JPY52W19V4IR93ENVK9K", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770945763571450, "job": 1, "event": "recovery_finished"} 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x565274b38e00 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: DB pointer 0x56527593e000 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout: ** DB Stats ** 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:22:43.883 INFO:journalctl@ceph.mon.a.trial091.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: ** Compaction Stats [default] ** 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: L0 2/0 79.89 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Sum 2/0 79.89 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:43.884 INFO:journalctl@ceph.mon.a.trial091.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: ** Compaction Stats [default] ** 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 78.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T01:22:43.885 INFO:journalctl@ceph.mon.a.trial091.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: Cumulative compaction: 0.00 GB write, 11.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: Interval compaction: 0.00 GB write, 11.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: Block cache BinnedLRUCache@0x565274b15690#2 capacity: 512.00 MB usage: 1.16 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.39 KB,7.45058e-05%) Misc(1,0.00 KB,0%) 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: starting mon.a rank 0 at public addrs [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] at bind addrs [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???) e1 preinit fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).mds e1 new map 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).mds e1 print_map 2026-02-13T01:22:43.886 INFO:journalctl@ceph.mon.a.trial091.stdout: e1 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout: btime 2026-02-13T01:22:42:667323+0000 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout: legacy client fscid: -1 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout: 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout: No filesystems configured 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T01:22:43.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: monmap epoch 1 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: last_changed 2026-02-13T01:22:41.751862+0000 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: created 2026-02-13T01:22:41.751862+0000 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: min_mon_release 20 (tentacle) 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: election_strategy: 1 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: 0: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.a 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: fsmap 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T01:22:43.888 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:43 trial091 ceph-mon[25068]: mgrmap e1: no daemons active 2026-02-13T01:22:43.960 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7155d718-087a-11f1-982a-d404e6e7d460.target.wants/ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-7155d718-087a-11f1-982a-d404e6e7d460@.service. 2026-02-13T01:22:44.108 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:22:44.108 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout disabled 2026-02-13T01:22:44.114 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:22:44.114 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout inactive 2026-02-13T01:22:44.115 INFO:teuthology.orchestra.run.trial091.stdout:firewalld.service is not enabled 2026-02-13T01:22:44.115 INFO:teuthology.orchestra.run.trial091.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T01:22:44.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 systemd[1]: Started Ceph mgr.x for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:22:44.121 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T01:22:44.121 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout disabled 2026-02-13T01:22:44.127 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T01:22:44.127 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout inactive 2026-02-13T01:22:44.128 INFO:teuthology.orchestra.run.trial091.stdout:firewalld.service is not enabled 2026-02-13T01:22:44.128 INFO:teuthology.orchestra.run.trial091.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T01:22:44.128 INFO:teuthology.orchestra.run.trial091.stdout:Waiting for mgr to start... 2026-02-13T01:22:44.128 INFO:teuthology.orchestra.run.trial091.stdout:Waiting for mgr... 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "fsid": "7155d718-087a-11f1-982a-d404e6e7d460", 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T01:22:44.319 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 0 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T01:22:44.320 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T01:22:44.321 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T01:22:42:667323+0000", 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T01:22:44.322 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:44.323 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T01:22:42.667652+0000", 2026-02-13T01:22:44.324 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:44.324 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:44.324 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T01:22:44.324 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:44.324 INFO:teuthology.orchestra.run.trial091.stdout:mgr not available, waiting (1/15)... 2026-02-13T01:22:44.422 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.119+0000 7f7a1aea4fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:22:44.422 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.158+0000 7f7a1aea4fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:22:44.422 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.422+0000 7f7a1aea4fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:22:44.704 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.431+0000 7f7a1aea4fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:22:44.705 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.438+0000 7f7a1aea4fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:22:44.705 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.445+0000 7f7a1aea4fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:22:44.705 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.451+0000 7f7a1aea4fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:22:44.705 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.463+0000 7f7a1aea4fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:22:44.705 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.487+0000 7f7a1aea4fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:22:44.706 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.490+0000 7f7a1aea4fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:22:44.706 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.492+0000 7f7a1aea4fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:22:44.706 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.499+0000 7f7a1aea4fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:22:44.706 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.536+0000 7f7a1aea4fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:22:44.706 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.537+0000 7f7a1aea4fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:22:44.706 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.541+0000 7f7a1aea4fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:22:44.707 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.543+0000 7f7a1aea4fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:22:44.707 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.544+0000 7f7a1aea4fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:22:44.707 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.547+0000 7f7a1aea4fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:22:44.707 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.548+0000 7f7a1aea4fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:22:44.707 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.551+0000 7f7a1aea4fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:22:44.707 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.553+0000 7f7a1aea4fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:22:44.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:44 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/341893984' entity='client.admin' 2026-02-13T01:22:44.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:44 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2221185129' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.724+0000 7f7a1aea4fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.724+0000 7f7a1aea4fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.726+0000 7f7a1aea4fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.729+0000 7f7a1aea4fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.730+0000 7f7a1aea4fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.731+0000 7f7a1aea4fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.731+0000 7f7a1aea4fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.876+0000 7f7a1aea4fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.905+0000 7f7a1aea4fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:22:44.978 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.909+0000 7f7a1aea4fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:22:44.979 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.910+0000 7f7a1aea4fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:22:44.979 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:44 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:44.910+0000 7f7a1aea4fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: Activating manager daemon x 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: mgrmap e2: x(active, starting, since 0.00255276s) 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:22:45.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: Manager daemon x is now available 2026-02-13T01:22:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:22:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' 2026-02-13T01:22:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:22:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' 2026-02-13T01:22:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:45 trial091 ceph-mon[25068]: from='mgr.14100 10.20.193.91:0/3843276592' entity='mgr.x' 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "fsid": "7155d718-087a-11f1-982a-d404e6e7d460", 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 0 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T01:22:46.595 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T01:22:46.596 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T01:22:42:667323+0000", 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ], 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T01:22:42.667652+0000", 2026-02-13T01:22:46.597 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T01:22:46.598 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout }, 2026-02-13T01:22:46.598 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T01:22:46.598 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:46.598 INFO:teuthology.orchestra.run.trial091.stdout:mgr is available 2026-02-13T01:22:46.823 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout fsid = 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.91:3300,v1:10.20.193.91:6789] 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:46.824 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T01:22:46.825 INFO:teuthology.orchestra.run.trial091.stdout:Enabling cephadm module... 2026-02-13T01:22:47.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:46 trial091 ceph-mon[25068]: mgrmap e3: x(active, since 1.00486s) 2026-02-13T01:22:47.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:46 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1201546380' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T01:22:47.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:46 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/729288081' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T01:22:48.182 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:47 trial091 ceph-mon[25068]: mgrmap e4: x(active, since 2s) 2026-02-13T01:22:48.183 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:47 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2566921222' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T01:22:48.183 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:47 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: ignoring --setuser ceph since I am not root 2026-02-13T01:22:48.183 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:47 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: ignoring --setgroup ceph since I am not root 2026-02-13T01:22:48.183 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:47 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:47.959+0000 7f963774efc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:22:48.183 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:47.999+0000 7f963774efc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:22:48.208 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:48.208 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T01:22:48.209 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T01:22:48.209 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T01:22:48.209 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T01:22:48.209 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:48.209 INFO:teuthology.orchestra.run.trial091.stdout:Waiting for the mgr to restart... 2026-02-13T01:22:48.209 INFO:teuthology.orchestra.run.trial091.stdout:Waiting for mgr epoch 5... 2026-02-13T01:22:48.477 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.257+0000 7f963774efc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:22:48.477 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.266+0000 7f963774efc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.272+0000 7f963774efc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.279+0000 7f963774efc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.285+0000 7f963774efc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.297+0000 7f963774efc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.322+0000 7f963774efc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.325+0000 7f963774efc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.327+0000 7f963774efc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.333+0000 7f963774efc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.369+0000 7f963774efc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.371+0000 7f963774efc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:22:48.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.375+0000 7f963774efc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:22:48.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.377+0000 7f963774efc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:22:48.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.378+0000 7f963774efc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:22:48.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.380+0000 7f963774efc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:22:48.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.381+0000 7f963774efc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:22:48.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.384+0000 7f963774efc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:22:48.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.387+0000 7f963774efc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:22:48.921 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.545+0000 7f963774efc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:22:48.921 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.545+0000 7f963774efc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:22:48.921 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.547+0000 7f963774efc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:22:48.921 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.549+0000 7f963774efc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.550+0000 7f963774efc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.551+0000 7f963774efc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.551+0000 7f963774efc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.691+0000 7f963774efc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.720+0000 7f963774efc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.724+0000 7f963774efc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.724+0000 7f963774efc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:22:48.922 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:48 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:22:48.725+0000 7f963774efc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:22:49.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2566921222' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T01:22:49.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: mgrmap e5: x(active, since 3s) 2026-02-13T01:22:49.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/883353076' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T01:22:49.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: Active manager daemon x restarted 2026-02-13T01:22:49.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: Activating manager daemon x 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: mgrmap e6: x(active, starting, since 0.00247442s) 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:22:49.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:48 trial091 ceph-mon[25068]: Manager daemon x is now available 2026-02-13T01:22:49.758 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout { 2026-02-13T01:22:49.759 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T01:22:49.759 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T01:22:49.759 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout } 2026-02-13T01:22:49.759 INFO:teuthology.orchestra.run.trial091.stdout:mgr epoch 5 is available 2026-02-13T01:22:49.759 INFO:teuthology.orchestra.run.trial091.stdout:Verifying orchestrator module is enabled... 2026-02-13T01:22:50.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: mgrmap e7: x(active, since 1.00482s) 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:50 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3791688048' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T01:22:50.755 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T01:22:50.755 INFO:teuthology.orchestra.run.trial091.stdout:Setting orchestrator backend to cephadm... 2026-02-13T01:22:51.225 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T01:22:51.225 INFO:teuthology.orchestra.run.trial091.stdout:Generating ssh key... 2026-02-13T01:22:51.503 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: Generating public/private ed25519 key pair. 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: Your identification has been saved in /tmp/tmpfn5mf7rf/key 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: Your public key has been saved in /tmp/tmpfn5mf7rf/key.pub 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: The key fingerprint is: 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: SHA256:Nv5GWqJ25XwdqGuTQr2y+SSv0VsIo8MLw4WwSBsEyIA ceph-7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: The key's randomart image is: 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: +--[ED25519 256]--+ 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: |O. | 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: |E. | 2026-02-13T01:22:51.504 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: | o. | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: |..oo . | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: |... . . S. . | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: | . o +o==.. . | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: | + +o+O++.. . | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: | ooo=BXo. . | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: | ...+O*+ | 2026-02-13T01:22:51.505 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:22:51 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: +----[SHA256]-----+ 2026-02-13T01:22:51.687 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:51.687 INFO:teuthology.orchestra.run.trial091.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:22:51.688 INFO:teuthology.orchestra.run.trial091.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T01:22:51.688 INFO:teuthology.orchestra.run.trial091.stdout:Adding host trial091... 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: Optimize plan auto_2026-02-13_01:22:48, mode upmap, max misplaced 0.050000 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: No pools available 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: Found migration_current of "None". Setting to last migration. 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3791688048' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: mgrmap e8: x(active, since 2s) 2026-02-13T01:22:51.781 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:51.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:51.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:51.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:51 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:52.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:52 trial091 ceph-mon[25068]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:52.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:52 trial091 ceph-mon[25068]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:52.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:52 trial091 ceph-mon[25068]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:52.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:52 trial091 ceph-mon[25068]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:52.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:52 trial091 ceph-mon[25068]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial091", "addr": "10.20.193.91", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:53.747 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout Added host 'trial091' with addr '10.20.193.91' 2026-02-13T01:22:53.748 INFO:teuthology.orchestra.run.trial091.stdout:Deploying unmanaged mon service... 2026-02-13T01:22:54.001 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T01:22:54.001 INFO:teuthology.orchestra.run.trial091.stdout:Deploying unmanaged mgr service... 2026-02-13T01:22:54.255 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T01:22:54.773 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:54 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:54.773 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:54 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:54.773 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:54 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:54.773 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:54 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:54.773 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:54 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:54.773 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:54 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3798778774' entity='client.admin' 2026-02-13T01:22:54.787 INFO:teuthology.orchestra.run.trial091.stdout:Saving cluster configuration to /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/config directory 2026-02-13T01:22:55.589 INFO:teuthology.orchestra.run.trial091.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T01:22:55.589 INFO:teuthology.orchestra.run.trial091.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T01:22:55.589 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.589 INFO:teuthology.orchestra.run.trial091.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: ceph telemetry on 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout:For more information see: 2026-02-13T01:22:55.590 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.591 INFO:teuthology.orchestra.run.trial091.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T01:22:55.591 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:55.591 INFO:teuthology.orchestra.run.trial091.stdout:Bootstrap complete. 2026-02-13T01:22:55.597 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout static 2026-02-13T01:22:55.603 INFO:teuthology.orchestra.run.trial091.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T01:22:55.603 INFO:teuthology.orchestra.run.trial091.stdout:systemctl: stdout inactive 2026-02-13T01:22:55.603 INFO:teuthology.orchestra.run.trial091.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T01:22:55.755 INFO:tasks.cephadm:Fetching config... 2026-02-13T01:22:55.755 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:55.755 DEBUG:teuthology.orchestra.run.trial091:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T01:22:55.771 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T01:22:55.772 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:55.772 DEBUG:teuthology.orchestra.run.trial091:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T01:22:55.829 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T01:22:55.829 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:55.830 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T01:22:55.894 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T01:22:55.894 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:22:55.894 DEBUG:teuthology.orchestra.run.trial091:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T01:22:55.950 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T01:22:55.950 DEBUG:teuthology.orchestra.run.trial091:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:22:56.010 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:55 trial091 ceph-mon[25068]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:56.010 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:55 trial091 ceph-mon[25068]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:56.010 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:55 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:56.010 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:55 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1401757670' entity='client.admin' 2026-02-13T01:22:56.021 INFO:teuthology.orchestra.run.trial091.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:56.031 DEBUG:teuthology.orchestra.run.trial126:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:22:56.066 INFO:teuthology.orchestra.run.trial126.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:56.075 DEBUG:teuthology.orchestra.run.trial154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T01:22:56.111 INFO:teuthology.orchestra.run.trial154.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINAT7LgtD5o9HhAieSMJuaidsz02YAtHQvZRvICIahMZ ceph-7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:22:56.122 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T01:22:56.241 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:22:56.511 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T01:22:56.511 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T01:22:56.629 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:22:56.784 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:56 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:56.784 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:56 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:56.784 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/919874878' entity='client.admin' 2026-02-13T01:22:56.902 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial126 2026-02-13T01:22:56.902 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:22:56.902 DEBUG:teuthology.orchestra.run.trial126:> dd of=/etc/ceph/ceph.conf 2026-02-13T01:22:56.921 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:22:56.921 DEBUG:teuthology.orchestra.run.trial126:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:56.979 INFO:tasks.cephadm:Adding host trial126 to orchestrator... 2026-02-13T01:22:56.980 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch host add trial126 2026-02-13T01:22:57.097 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:22:58.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:58.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:58.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:57 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:59.182 INFO:teuthology.orchestra.run.trial091.stdout:Added host 'trial126' with addr '10.20.193.126' 2026-02-13T01:22:59.182 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:58 trial091 ceph-mon[25068]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial126", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:22:59.183 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:58 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:22:59.183 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:58 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:22:59.183 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:58 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:22:59.183 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:22:58 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:22:59.233 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T01:22:59.351 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:22:59.570 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:22:59.571 INFO:teuthology.orchestra.run.trial091.stdout:[{"addr": "10.20.193.91", "hostname": "trial091", "labels": [], "status": ""}, {"addr": "10.20.193.126", "hostname": "trial126", "labels": [], "status": ""}] 2026-02-13T01:22:59.614 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial154 2026-02-13T01:22:59.614 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:22:59.614 DEBUG:teuthology.orchestra.run.trial154:> dd of=/etc/ceph/ceph.conf 2026-02-13T01:22:59.632 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:22:59.632 DEBUG:teuthology.orchestra.run.trial154:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:22:59.689 INFO:tasks.cephadm:Adding host trial154 to orchestrator... 2026-02-13T01:22:59.689 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch host add trial154 2026-02-13T01:22:59.808 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:00 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:00 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:00 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:00 trial091 ceph-mon[25068]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:23:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:00 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:01.880 INFO:teuthology.orchestra.run.trial091.stdout:Added host 'trial154' with addr '10.20.193.154' 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial154", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial126", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:01.881 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:01 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:01.925 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T01:23:02.040 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:02.257 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:23:02.257 INFO:teuthology.orchestra.run.trial091.stdout:[{"addr": "10.20.193.91", "hostname": "trial091", "labels": [], "status": ""}, {"addr": "10.20.193.126", "hostname": "trial126", "labels": [], "status": ""}, {"addr": "10.20.193.154", "hostname": "trial154", "labels": [], "status": ""}] 2026-02-13T01:23:02.323 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T01:23:02.324 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T01:23:02.441 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:03.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:03.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:03.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:03.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:03.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:03.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:03.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:03.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:02 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/381188572' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T01:23:03.479 INFO:teuthology.orchestra.run.trial091.stderr:adjusted tunables profile to default 2026-02-13T01:23:03.526 INFO:tasks.cephadm:Adding mon.a on trial091 2026-02-13T01:23:03.526 INFO:tasks.cephadm:Adding mon.b on trial126 2026-02-13T01:23:03.526 INFO:tasks.cephadm:Adding mon.c on trial154 2026-02-13T01:23:03.526 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch apply mon '3;trial091:10.20.193.91=a;trial126:10.20.193.126=b;trial154:10.20.193.154=c' 2026-02-13T01:23:03.647 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:03.647 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:03.883 INFO:teuthology.orchestra.run.trial154.stdout:Scheduled mon update... 2026-02-13T01:23:03.923 DEBUG:teuthology.orchestra.run.trial126:mon.b> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.b.service 2026-02-13T01:23:03.926 DEBUG:teuthology.orchestra.run.trial154:mon.c> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.c.service 2026-02-13T01:23:03.929 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:23:03.929 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:23:04.096 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:04.096 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T01:23:04.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:03 trial091 ceph-mon[25068]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:23:04.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:03 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:04.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:03 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/381188572' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T01:23:04.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:03 trial091 ceph-mon[25068]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:04.417 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:23:04.417 INFO:teuthology.orchestra.run.trial154.stdout:{"epoch":1,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","modified":"2026-02-13T01:22:41.751862Z","created":"2026-02-13T01:22:41.751862Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:3300","nonce":0},{"type":"v1","addr":"10.20.193.91:6789","nonce":0}]},"addr":"10.20.193.91:6789/0","public_addr":"10.20.193.91:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:22:41:751873+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T01:23:04.418 INFO:teuthology.orchestra.run.trial154.stderr:dumped monmap epoch 1 2026-02-13T01:23:05.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial091:10.20.193.91=a;trial126:10.20.193.126=b;trial154:10.20.193.154=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:05.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/12692277' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:05.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:04 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:05.458 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:23:05.459 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:23:05.680 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:23:06.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:05 trial154 ceph-mon[27045]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T01:23:10.940 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:23:10.941 INFO:teuthology.orchestra.run.trial154.stdout:{"epoch":2,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","modified":"2026-02-13T01:23:05.935037Z","created":"2026-02-13T01:22:41.751862Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:3300","nonce":0},{"type":"v1","addr":"10.20.193.91:6789","nonce":0}]},"addr":"10.20.193.91:6789/0","public_addr":"10.20.193.91:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:22:41:751873+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:3300","nonce":0},{"type":"v1","addr":"10.20.193.154:6789","nonce":0}]},"addr":"10.20.193.154:6789/0","public_addr":"10.20.193.154:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:23:05:935035+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T01:23:10.941 INFO:teuthology.orchestra.run.trial154.stderr:dumped monmap epoch 2 2026-02-13T01:23:11.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: mon.a calling monitor election 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/1354612691' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: mon.c calling monitor election 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: monmap epoch 2 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: last_changed 2026-02-13T01:23:05.935037+0000 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: created 2026-02-13T01:22:41.751862+0000 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: min_mon_release 20 (tentacle) 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: election_strategy: 1 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: 0: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.a 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: fsmap 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:11.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: mgrmap e8: x(active, since 22s) 2026-02-13T01:23:11.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: overall HEALTH_OK 2026-02-13T01:23:11.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:11.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:11.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:11.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:11.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:10 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:11.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:11.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: mon.a calling monitor election 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/1354612691' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: mon.c calling monitor election 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T01:23:11.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: monmap epoch 2 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: last_changed 2026-02-13T01:23:05.935037+0000 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: created 2026-02-13T01:22:41.751862+0000 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: min_mon_release 20 (tentacle) 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: election_strategy: 1 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: 0: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.a 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: fsmap 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: mgrmap e8: x(active, since 22s) 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: overall HEALTH_OK 2026-02-13T01:23:11.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:11.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:11.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:11.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:11.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:10 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:12.109 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T01:23:12.109 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T01:23:12.230 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:23:12.253 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:11 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:12.379 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:11 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:12.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:12 trial126 ceph-mon[26569]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T01:23:17.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: mon.c calling monitor election 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: mon.a calling monitor election 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: mon.b calling monitor election 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: monmap epoch 3 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: last_changed 2026-02-13T01:23:12.271005+0000 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: created 2026-02-13T01:22:41.751862+0000 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: min_mon_release 20 (tentacle) 2026-02-13T01:23:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: election_strategy: 1 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: 0: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.a 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: 2: [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] mon.b 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: fsmap 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: mgrmap e8: x(active, since 28s) 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: overall HEALTH_OK 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:17 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.680 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: mon.c calling monitor election 2026-02-13T01:23:17.680 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:17.680 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.680 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:17.680 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: mon.a calling monitor election 2026-02-13T01:23:17.680 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: mon.b calling monitor election 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: monmap epoch 3 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:17.681 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: last_changed 2026-02-13T01:23:12.271005+0000 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: created 2026-02-13T01:22:41.751862+0000 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: min_mon_release 20 (tentacle) 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: election_strategy: 1 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: 0: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.a 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: 2: [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] mon.b 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: fsmap 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: mgrmap e8: x(active, since 28s) 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: overall HEALTH_OK 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.682 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.683 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:17 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: mon.c calling monitor election 2026-02-13T01:23:17.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: mon.a calling monitor election 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: mon.b calling monitor election 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: monmap epoch 3 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: fsid 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: last_changed 2026-02-13T01:23:12.271005+0000 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: created 2026-02-13T01:22:41.751862+0000 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: min_mon_release 20 (tentacle) 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: election_strategy: 1 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: 0: [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] mon.a 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: 1: [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] mon.c 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: 2: [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] mon.b 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: fsmap 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T01:23:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: mgrmap e8: x(active, since 28s) 2026-02-13T01:23:17.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: overall HEALTH_OK 2026-02-13T01:23:17.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:17.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:17 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.492 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:23:18.492 INFO:teuthology.orchestra.run.trial154.stdout:{"epoch":3,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","modified":"2026-02-13T01:23:12.271005Z","created":"2026-02-13T01:22:41.751862Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:3300","nonce":0},{"type":"v1","addr":"10.20.193.91:6789","nonce":0}]},"addr":"10.20.193.91:6789/0","public_addr":"10.20.193.91:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:22:41:751873+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:3300","nonce":0},{"type":"v1","addr":"10.20.193.154:6789","nonce":0}]},"addr":"10.20.193.154:6789/0","public_addr":"10.20.193.154:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:23:05:935035+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:3300","nonce":0},{"type":"v1","addr":"10.20.193.126:6789","nonce":0}]},"addr":"10.20.193.126:6789/0","public_addr":"10.20.193.126:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T01:23:12:271003+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T01:23:18.492 INFO:teuthology.orchestra.run.trial154.stderr:dumped monmap epoch 3 2026-02-13T01:23:18.532 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T01:23:18.532 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T01:23:18.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:18.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:18.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:18.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:18 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:18.652 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.677 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:18 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:18.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:18.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:18.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:18.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:18.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:18 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:18.874 INFO:teuthology.orchestra.run.trial091.stdout:# minimal ceph.conf for 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:18.875 INFO:teuthology.orchestra.run.trial091.stdout:[global] 2026-02-13T01:23:18.875 INFO:teuthology.orchestra.run.trial091.stdout: fsid = 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:23:18.875 INFO:teuthology.orchestra.run.trial091.stdout: mon_host = [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] 2026-02-13T01:23:18.916 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T01:23:18.916 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:23:18.916 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:18.943 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:23:18.943 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:19.008 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:23:19.008 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:19.036 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:23:19.036 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:19.100 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:23:19.100 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T01:23:19.127 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:23:19.127 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T01:23:19.193 INFO:tasks.cephadm:enabling module snap_schedule 2026-02-13T01:23:19.193 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2026-02-13T01:23:19.311 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:19.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/4244846732' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/61057926' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:19.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:19 trial126 ceph-mon[26569]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/4244846732' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/61057926' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:19.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:19.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:19 trial154 ceph-mon[27045]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/4244846732' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/61057926' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:19.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:19 trial091 ceph-mon[25068]: from='mgr.14116 10.20.193.91:0/3444720013' entity='mgr.x' 2026-02-13T01:23:20.543 INFO:tasks.cephadm:Adding mgr.x on trial091 2026-02-13T01:23:20.544 INFO:tasks.cephadm:Adding mgr.y on trial126 2026-02-13T01:23:20.544 INFO:tasks.cephadm:Adding mgr.z on trial154 2026-02-13T01:23:20.544 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch apply mgr '3;trial091=x;trial126=y;trial154=z' 2026-02-13T01:23:20.660 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:23:20.775 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:20 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/323666982' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T01:23:20.826 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:20 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/323666982' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T01:23:20.826 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: ignoring --setuser ceph since I am not root 2026-02-13T01:23:20.827 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: ignoring --setgroup ceph since I am not root 2026-02-13T01:23:20.827 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.536+0000 7fcbe2a23fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:23:20.827 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.576+0000 7fcbe2a23fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:23:20.827 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.826+0000 7fcbe2a23fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:23:20.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:20 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/323666982' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T01:23:21.115 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.835+0000 7fcbe2a23fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:23:21.115 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.841+0000 7fcbe2a23fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.848+0000 7fcbe2a23fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.854+0000 7fcbe2a23fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.866+0000 7fcbe2a23fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.890+0000 7fcbe2a23fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.893+0000 7fcbe2a23fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.895+0000 7fcbe2a23fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.901+0000 7fcbe2a23fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.938+0000 7fcbe2a23fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.940+0000 7fcbe2a23fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.944+0000 7fcbe2a23fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:23:21.116 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.946+0000 7fcbe2a23fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.947+0000 7fcbe2a23fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.950+0000 7fcbe2a23fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.951+0000 7fcbe2a23fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.953+0000 7fcbe2a23fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:20.956+0000 7fcbe2a23fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.115+0000 7fcbe2a23fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:23:21.117 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.115+0000 7fcbe2a23fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:23:21.477 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.117+0000 7fcbe2a23fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:23:21.477 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.120+0000 7fcbe2a23fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.121+0000 7fcbe2a23fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.122+0000 7fcbe2a23fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.122+0000 7fcbe2a23fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.262+0000 7fcbe2a23fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.290+0000 7fcbe2a23fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.294+0000 7fcbe2a23fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.295+0000 7fcbe2a23fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:23:21.296+0000 7fcbe2a23fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:345: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T01:23:21.478 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: tz = given_cert.not_valid_after.tzinfo 2026-02-13T01:23:21.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:346: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T01:23:21.479 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:23:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: if datetime.now(tz) >= given_cert.not_valid_after: 2026-02-13T01:23:21.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/323666982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T01:23:21.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: mgrmap e9: x(active, since 31s) 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: Active manager daemon x restarted 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: Activating manager daemon x 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: mgrmap e10: x(active, starting, since 0.00326488s) 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:23:21.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: Manager daemon x is now available 2026-02-13T01:23:21.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:21.942 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/323666982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: mgrmap e9: x(active, since 31s) 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: Active manager daemon x restarted 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: Activating manager daemon x 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: mgrmap e10: x(active, starting, since 0.00326488s) 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:21.943 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:23:21.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:23:21.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:23:21.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:23:21.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: Manager daemon x is now available 2026-02-13T01:23:21.944 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/323666982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: mgrmap e9: x(active, since 31s) 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: Active manager daemon x restarted 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: Activating manager daemon x 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: mgrmap e10: x(active, starting, since 0.00326488s) 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T01:23:21.947 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T01:23:21.948 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T01:23:21.948 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T01:23:21.948 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: Manager daemon x is now available 2026-02-13T01:23:21.948 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:22.309 INFO:teuthology.orchestra.run.trial154.stdout:Scheduled mgr update... 2026-02-13T01:23:22.353 DEBUG:teuthology.orchestra.run.trial126:mgr.y> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.y.service 2026-02-13T01:23:22.355 DEBUG:teuthology.orchestra.run.trial154:mgr.z> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.z.service 2026-02-13T01:23:22.358 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T01:23:22.358 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T01:23:22.360 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T01:23:22.361 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T01:23:22.403 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T01:23:22.403 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T01:23:22.447 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T01:23:22.447 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T01:23:22.480 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.481 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T01:23:22.482 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T01:23:22.522 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.524 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T01:23:22.524 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T01:23:22.566 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T01:23:22.567 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T01:23:22.568 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.600 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.601 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T01:23:22.601 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T01:23:22.632 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:23:22.632 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:23:22.632 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: mgrmap e11: x(active, since 1.00708s) 2026-02-13T01:23:22.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.634 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T01:23:22.634 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T01:23:22.645 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.646 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T01:23:22.646 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T01:23:22.687 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.688 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T01:23:22.688 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T01:23:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:23:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:23:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: mgrmap e11: x(active, since 1.00708s) 2026-02-13T01:23:22.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.731 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T01:23:22.732 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T01:23:22.732 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.768 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.769 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T01:23:22.770 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T01:23:22.775 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T01:23:22.775 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T01:23:22.779 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.781 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T01:23:22.781 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T01:23:22.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.818+0000 7f53121396c0 1 -- 10.20.193.91:0/254587136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f52e003f820 msgr2=0x7f52e005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.818+0000 7f53121396c0 1 --2- 10.20.193.91:0/254587136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f52e003f820 0x7f52e005fcd0 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52fc004750 tx=0x7f52fc009260 comp rx=0 tx=0).stop 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.818+0000 7f53121396c0 1 -- 10.20.193.91:0/254587136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f530c10eed0 msgr2=0x7f530c0f8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.818+0000 7f53121396c0 1 --2- 10.20.193.91:0/254587136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f530c10eed0 0x7f530c0f8970 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f52f802f680 tx=0x7f52f80046b0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 -- 10.20.193.91:0/254587136 shutdown_connections 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 --2- 10.20.193.91:0/254587136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f52e003f820 0x7f52e005fcd0 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 --2- 10.20.193.91:0/254587136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f530c110a00 0x7f530c0f91d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 --2- 10.20.193.91:0/254587136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f530c110050 0x7f530c171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 --2- 10.20.193.91:0/254587136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f530c10eed0 0x7f530c0f8970 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 -- 10.20.193.91:0/254587136 >> 10.20.193.91:0/254587136 conn(0x7f530c0ec5f0 msgr2=0x7f530c0eee20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.819 INFO:tasks.cephadm:setting config [mds] mds_use_global_snaprealm_seq_for_subvol = False 2026-02-13T01:23:22.819 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_use_global_snaprealm_seq_for_subvol False 2026-02-13T01:23:22.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 -- 10.20.193.91:0/254587136 shutdown_connections 2026-02-13T01:23:22.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.819+0000 7f53121396c0 1 -- 10.20.193.91:0/254587136 wait complete. 2026-02-13T01:23:22.832 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.834 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T01:23:22.834 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T01:23:22.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/4234050984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 msgr2=0x7f32e810e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 --2- 10.20.193.91:0/4234050984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e810e240 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=17498440092556218529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d0009970 tx=0x7f32d002ed70 comp rx=0 tx=0).stop 2026-02-13T01:23:22.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/4234050984 shutdown_connections 2026-02-13T01:23:22.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 --2- 10.20.193.91:0/4234050984 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810e780 0x7f32e816f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 --2- 10.20.193.91:0/4234050984 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e810e240 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=17498440092556218529 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 --2- 10.20.193.91:0/4234050984 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e810cc50 0x7f32e810d040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/4234050984 >> 10.20.193.91:0/4234050984 conn(0x7f32e80ea370 msgr2=0x7f32e810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/4234050984 shutdown_connections 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.834+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/4234050984 wait complete. 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.835+0000 7f32ecfbb6c0 1 Processor -- start 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.835+0000 7f32ecfbb6c0 1 -- start start 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.835+0000 7f32ecfbb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810cc50 0x7f32e80f65b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.835+0000 7f32ecfbb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e816f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.835+0000 7f32ecfbb6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e810e780 0x7f32e80f6e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32ecfbb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f32e80f7a40 con 0x7f32e810ddd0 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e65756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810cc50 0x7f32e80f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e65756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810cc50 0x7f32e80f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:36898/0 (socket says 10.20.193.91:36898) 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e65756c0 1 -- 10.20.193.91:0/3626458877 learned_addr learned my addr 10.20.193.91:0/3626458877 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e816f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e6d766c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e810e780 0x7f32e80f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f32e80f7bb0 con 0x7f32e810e780 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32e80f7d70 con 0x7f32e810cc50 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 -- 10.20.193.91:0/3626458877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810cc50 msgr2=0x7f32e80f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810cc50 0x7f32e80f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 -- 10.20.193.91:0/3626458877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e810e780 msgr2=0x7f32e80f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e810e780 0x7f32e80f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d0009590 con 0x7f32e810ddd0 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32e5d746c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e816f110 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d0009970 tx=0x7f32d00028e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d00056c0 con 0x7f32e810ddd0 2026-02-13T01:23:22.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(25 keys) ==== 1050+0+0 (secure 0 0 0) 0x7f32d00347b0 con 0x7f32e810ddd0 2026-02-13T01:23:22.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.836+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d0007660 con 0x7f32e810ddd0 2026-02-13T01:23:22.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.837+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e80f7ff0 con 0x7f32e810ddd0 2026-02-13T01:23:22.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.837+0000 7f32ecfbb6c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e80f8360 con 0x7f32e810ddd0 2026-02-13T01:23:22.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.837+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b0005100 con 0x7f32e810ddd0 2026-02-13T01:23:22.841 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T01:23:22.841 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T01:23:22.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.838+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f32d0034920 con 0x7f32e810ddd0 2026-02-13T01:23:22.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.838+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd290002e50 con 0x7fd2c810a910 2026-02-13T01:23:22.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.839+0000 7f32cf7fe6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32c003f820 0x7f32c005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.839+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f32d0079850 con 0x7f32e810ddd0 2026-02-13T01:23:22.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.839+0000 7f32e65756c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32c003f820 0x7f32c005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.839+0000 7f32e65756c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32c003f820 0x7f32c005fcd0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc0095e0 tx=0x7f32dc009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.840+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f32d003d260 con 0x7f32e810ddd0 2026-02-13T01:23:22.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.843+0000 7fd2c4ff96c0 1 -- 10.20.193.91:0/2452284687 <== mon.0 v2:10.20.193.91:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fd2b40108b0 con 0x7fd2c810a910 2026-02-13T01:23:22.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.844+0000 7fd2c4ff96c0 1 -- 10.20.193.91:0/2452284687 <== mon.0 v2:10.20.193.91:3300/0 10 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fd2b400ce10 con 0x7fd2c810a910 2026-02-13T01:23:22.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.844+0000 7f095d7fa6c0 1 -- 10.20.193.91:0/98293310 <== mon.1 v2:10.20.193.154:3300/0 8 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f0954033c70 con 0x7f096010e760 2026-02-13T01:23:22.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.844+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 7 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f32d003d260 con 0x7f32e810ddd0 2026-02-13T01:23:22.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.848+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd29c03f820 msgr2=0x7fd29c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.848+0000 7fd2a27fc6c0 1 --2- 10.20.193.91:0/2452284687 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd29c03f820 0x7fd29c05fcd0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b80098c0 tx=0x7fd2b80023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.848+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2c810a910 msgr2=0x7fd2c815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.848+0000 7fd2a27fc6c0 1 --2- 10.20.193.91:0/2452284687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2c810a910 0x7fd2c815f1f0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b400ba30 tx=0x7fd2b400bf00 comp rx=0 tx=0).stop 2026-02-13T01:23:22.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T01:23:22.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T01:23:22.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: mgrmap e11: x(active, since 1.00708s) 2026-02-13T01:23:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:22.854 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T01:23:22.855 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.849+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 shutdown_connections 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.849+0000 7fd2a27fc6c0 1 --2- 10.20.193.91:0/2452284687 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd29c03f820 0x7fd29c05fcd0 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.849+0000 7fd2a27fc6c0 1 --2- 10.20.193.91:0/2452284687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2c814eb00 0x7fd2c8160430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.849+0000 7fd2a27fc6c0 1 --2- 10.20.193.91:0/2452284687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c810b240 0x7fd2c815f840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.849+0000 7fd2a27fc6c0 1 --2- 10.20.193.91:0/2452284687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2c810a910 0x7fd2c815f1f0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.849+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 >> 10.20.193.91:0/2452284687 conn(0x7fd2c80e8510 msgr2=0x7fd2c81088f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.852+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 shutdown_connections 2026-02-13T01:23:22.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.853+0000 7fd2a27fc6c0 1 -- 10.20.193.91:0/2452284687 wait complete. 2026-02-13T01:23:22.862 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T01:23:22.862 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T01:23:22.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.888+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/2924831845 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc05f750 msgr2=0x7fb4dc12d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.888+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/2924831845 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d910 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=13325207289566717612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d0009970 tx=0x7fb4d002ed70 comp rx=0 tx=0).stop 2026-02-13T01:23:22.888 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.890 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T01:23:22.890 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T01:23:22.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.892+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/2924831845 shutdown_connections 2026-02-13T01:23:22.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.892+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/2924831845 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 0x7fb4dc16edd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.892+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/2924831845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc12de50 0x7fb4dc14e230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.892+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/2924831845 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d910 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=13325207289566717612 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.892+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/2924831845 >> 10.20.193.91:0/2924831845 conn(0x7fb4dc0e91f0 msgr2=0x7fb4dc109620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.892+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/2924831845 shutdown_connections 2026-02-13T01:23:22.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.895+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/2924831845 wait complete. 2026-02-13T01:23:22.896 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2026-02-13T01:23:22.896 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr debug_cephsqlite 20 2026-02-13T01:23:22.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 Processor -- start 2026-02-13T01:23:22.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 -- start start 2026-02-13T01:23:22.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc12de50 0x7fb4dc1095d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 0x7fb4dc160410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc160ba0 con 0x7fb4dc12de50 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc160d10 con 0x7fb4dc05f750 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4e0f986c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4dc160ed0 con 0x7fb4dc14e920 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4da5756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4da5756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d840 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:50450/0 (socket says 10.20.193.91:50450) 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4da5756c0 1 -- 10.20.193.91:0/683503738 learned_addr learned my addr 10.20.193.91:0/683503738 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.896+0000 7fb4d9d746c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc12de50 0x7fb4dc1095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4dad766c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 0x7fb4dc160410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4d9d746c0 1 -- 10.20.193.91:0/683503738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 msgr2=0x7fb4dc160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4d9d746c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 0x7fb4dc160410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4d9d746c0 1 -- 10.20.193.91:0/683503738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 msgr2=0x7fb4dc12d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4d9d746c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4d9d746c0 1 -- 10.20.193.91:0/683503738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d0009590 con 0x7fb4dc12de50 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4d9d746c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc12de50 0x7fb4dc1095d0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c400b6e0 tx=0x7fb4c400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4dad766c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 0x7fb4dc160410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:22.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4da5756c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4c4004a80 con 0x7fb4dc12de50 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.897+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fb4c4009030 con 0x7fb4dc12de50 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.898+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb4c400cc30 con 0x7fb4dc12de50 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.898+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4dc161590 con 0x7fb4dc12de50 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.899+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4dc161990 con 0x7fb4dc12de50 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.900+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fb4c4004fb0 con 0x7fb4dc12de50 2026-02-13T01:23:22.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.900+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4dc162430 con 0x7fb4dc12de50 2026-02-13T01:23:22.901 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T01:23:22.902 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T01:23:22.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.904+0000 7fb4c37fe6c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb4b403f7f0 0x7fb4b405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.904+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb4c4055550 con 0x7fb4dc12de50 2026-02-13T01:23:22.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.904+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb4c4055840 con 0x7fb4dc12de50 2026-02-13T01:23:22.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.904+0000 7fb4da5756c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb4b403f7f0 0x7fb4b405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.905+0000 7fb4da5756c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb4b403f7f0 0x7fb4b405fca0 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d0031fd0 tx=0x7fb4d0005b00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.915+0000 7f6159db16c0 1 -- 10.20.193.91:0/3826777536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 msgr2=0x7f61541139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.916 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T01:23:22.916 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T01:23:22.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.915+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3826777536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61541139d0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=17919413137493295887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6144009970 tx=0x7f614402ed70 comp rx=0 tx=0).stop 2026-02-13T01:23:22.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 -- 10.20.193.91:0/3826777536 shutdown_connections 2026-02-13T01:23:22.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3826777536 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3826777536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61541139d0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=17919413137493295887 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3826777536 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 0x7f6154114be0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 -- 10.20.193.91:0/3826777536 >> 10.20.193.91:0/3826777536 conn(0x7f6154064300 msgr2=0x7f6154064700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 -- 10.20.193.91:0/3826777536 shutdown_connections 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.916+0000 7f6159db16c0 1 -- 10.20.193.91:0/3826777536 wait complete. 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6159db16c0 1 Processor -- start 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6159db16c0 1 -- start start 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6159db16c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61540fe9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6159db16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6159db16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 0x7f61540ff200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6159db16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f61540ffe30 con 0x7f61541147f0 2026-02-13T01:23:22.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f61537fe6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61540fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f61537fe6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61540fe9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:50458/0 (socket says 10.20.193.91:50458) 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.917+0000 7f6152ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:36926/0 (socket says 10.20.193.91:36926) 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 -- 10.20.193.91:0/3798379122 learned_addr learned my addr 10.20.193.91:0/3798379122 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6153fff6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 0x7f61540ff200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f61540fffa0 con 0x7f6154113560 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6154100160 con 0x7f6154113f10 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 -- 10.20.193.91:0/3798379122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 msgr2=0x7f61540fe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61540fe9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 -- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 msgr2=0x7f61540ff200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 0x7f61540ff200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6144009590 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6153fff6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 0x7f61540ff200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6152ffd6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6144005ae0 tx=0x7f6144002960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.918+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6144005e90 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.919+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f61440046b0 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.919+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6144031340 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.919+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61541003e0 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.919+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6154100810 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.919+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6154100a30 con 0x7f6154113f10 2026-02-13T01:23:22.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.920+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f61440071c0 con 0x7f6154113f10 2026-02-13T01:23:22.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.920+0000 7f6150ff96c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f612803f820 0x7f612805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.920+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f61440756a0 con 0x7f6154113f10 2026-02-13T01:23:22.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.920+0000 7f61537fe6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f612803f820 0x7f612805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.924 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T01:23:22.924 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T01:23:22.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.921+0000 7f61537fe6c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f612803f820 0x7f612805fcd0 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6140006fd0 tx=0x7f6140009190 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.924+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f614403a6a0 con 0x7f6154113f10 2026-02-13T01:23:22.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.926+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f0920002f90 con 0x7f096010e760 2026-02-13T01:23:22.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.929+0000 7f095d7fa6c0 1 -- 10.20.193.91:0/98293310 <== mon.1 v2:10.20.193.154:3300/0 9 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f09540085d0 con 0x7f096010e760 2026-02-13T01:23:22.931 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2026-02-13T01:23:22.931 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2026-02-13T01:23:22.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.930+0000 7f095d7fa6c0 1 -- 10.20.193.91:0/98293310 <== mon.1 v2:10.20.193.154:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f09540089c0 con 0x7f096010e760 2026-02-13T01:23:22.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.932+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 8 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f32d003b8e0 con 0x7f32e810ddd0 2026-02-13T01:23:22.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.930+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 7 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f614403a6a0 con 0x7f6154113f10 2026-02-13T01:23:22.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.933+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 7 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb4c40073b0 con 0x7fb4dc12de50 2026-02-13T01:23:22.934 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.935+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f093403f820 msgr2=0x7f093405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.935+0000 7f093affd6c0 1 --2- 10.20.193.91:0/98293310 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f093403f820 0x7f093405fcd0 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f094c005dc0 tx=0x7f094c005d30 comp rx=0 tx=0).stop 2026-02-13T01:23:22.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.935+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f096010e760 msgr2=0x7f09600f6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.935+0000 7f093affd6c0 1 --2- 10.20.193.91:0/98293310 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f096010e760 0x7f09600f6e50 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f095400a580 tx=0x7f0954005570 comp rx=0 tx=0).stop 2026-02-13T01:23:22.942 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2026-02-13T01:23:22.942 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2026-02-13T01:23:22.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 shutdown_connections 2026-02-13T01:23:22.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 --2- 10.20.193.91:0/98293310 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f093403f820 0x7f093405fcd0 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 --2- 10.20.193.91:0/98293310 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f096010e760 0x7f09600f6e50 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 --2- 10.20.193.91:0/98293310 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f096010ddb0 0x7f096016f0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 --2- 10.20.193.91:0/98293310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f096010cc30 0x7f09600f65f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 >> 10.20.193.91:0/98293310 conn(0x7f09600ea330 msgr2=0x7f09600ecad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 shutdown_connections 2026-02-13T01:23:22.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.936+0000 7f093affd6c0 1 -- 10.20.193.91:0/98293310 wait complete. 2026-02-13T01:23:22.958 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.960 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2026-02-13T01:23:22.960 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/log_level debug 2026-02-13T01:23:22.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.963+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2039901687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478113f70 msgr2=0x7fc478134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.963+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2039901687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478113f70 0x7fc478134350 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=5663927979974890075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc460009970 tx=0x7fc46002ed30 comp rx=0 tx=0).stop 2026-02-13T01:23:22.962 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:22.963 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T01:23:22.964 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T01:23:22.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2039901687 shutdown_connections 2026-02-13T01:23:22.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2039901687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4781554e0 0x7fc478175990 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2039901687 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc478134920 0x7fc478154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2039901687 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478113f70 0x7fc478134350 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=5663927979974890075 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2039901687 >> 10.20.193.91:0/2039901687 conn(0x7fc47805b8e0 msgr2=0x7fc47805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2039901687 shutdown_connections 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.964+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2039901687 wait complete. 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 Processor -- start 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 -- start start 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc478113f70 0x7fc478175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478134920 0x7fc478154d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 0x7fc4780fcd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc4780fd4d0 con 0x7fc4781554e0 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc4780fd640 con 0x7fc478113f70 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc47cfe06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4780fdca0 con 0x7fc478134920 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc476d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 0x7fc4780fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc476d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 0x7fc4780fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51730/0 (socket says 10.20.193.91:51730) 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.965+0000 7fc476d766c0 1 -- 10.20.193.91:0/2019957873 learned_addr learned my addr 10.20.193.91:0/2019957873 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc476d766c0 1 -- 10.20.193.91:0/2019957873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478134920 msgr2=0x7fc478154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc476d766c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478134920 0x7fc478154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc476d766c0 1 -- 10.20.193.91:0/2019957873 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc478113f70 msgr2=0x7fc478175970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc476d766c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc478113f70 0x7fc478175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc476d766c0 1 -- 10.20.193.91:0/2019957873 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4680094c0 con 0x7fc4781554e0 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc476d766c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 0x7fc4780fcd40 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47000c6c0 tx=0x7fc47000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc470003ce0 con 0x7fc4781554e0 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc460009590 con 0x7fc4781554e0 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc47000ce70 con 0x7fc4781554e0 2026-02-13T01:23:22.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4780fe2d0 con 0x7fc4781554e0 2026-02-13T01:23:22.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.966+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc47000dcf0 con 0x7fc4781554e0 2026-02-13T01:23:22.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.967+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fc470005030 con 0x7fc4781554e0 2026-02-13T01:23:22.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.967+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43c005310 con 0x7fc4781554e0 2026-02-13T01:23:22.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.967+0000 7fc45f7fe6c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc45003f820 0x7fc45005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:22.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.967+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc470052150 con 0x7fc4781554e0 2026-02-13T01:23:22.971 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T01:23:22.971 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T01:23:22.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.969+0000 7fc4765756c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc45003f820 0x7fc45005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:22.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.969+0000 7fc4765756c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc45003f820 0x7fc45005fcd0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4600098c0 tx=0x7fc460005c40 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:22.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.972+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc4700088f0 con 0x7fc4781554e0 2026-02-13T01:23:22.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.987+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f32b00053b0 con 0x7f32e810ddd0 2026-02-13T01:23:22.987 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T01:23:22.987 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T01:23:22.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:22.990+0000 7f32cf7fe6c0 1 -- 10.20.193.91:0/3626458877 <== mon.0 v2:10.20.193.91:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f32d003a550 con 0x7f32e810ddd0 2026-02-13T01:23:22.996 DEBUG:tasks.cephadm:set 31 configs 2026-02-13T01:23:22.996 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial091') 2026-02-13T01:23:22.996 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial091') 2026-02-13T01:23:22.996 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial091') 2026-02-13T01:23:22.996 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial091') 2026-02-13T01:23:22.997 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.000+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32c003f820 msgr2=0x7f32c005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.000+0000 7f32cd7fa6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32c003f820 0x7f32c005fcd0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc0095e0 tx=0x7f32dc009260 comp rx=0 tx=0).stop 2026-02-13T01:23:23.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.000+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 msgr2=0x7f32e816f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.000+0000 7f32cd7fa6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e816f110 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d0009970 tx=0x7f32d00028e0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.001 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.002+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 shutdown_connections 2026-02-13T01:23:23.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.002+0000 7f32cd7fa6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32c003f820 0x7f32c005fcd0 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.002+0000 7f32cd7fa6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e810e780 0x7f32e80f6e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.002+0000 7f32cd7fa6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e810ddd0 0x7f32e816f110 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.002+0000 7f32cd7fa6c0 1 --2- 10.20.193.91:0/3626458877 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e810cc50 0x7f32e80f65b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.002+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 >> 10.20.193.91:0/3626458877 conn(0x7f32e80ea370 msgr2=0x7f32e80ecb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.007+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 shutdown_connections 2026-02-13T01:23:23.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.007+0000 7f32cd7fa6c0 1 -- 10.20.193.91:0/3626458877 wait complete. 2026-02-13T01:23:23.036 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.044 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.052+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/1320258094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5854115120 msgr2=0x7f58541155c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.052+0000 7f585c1eb6c0 1 --2- 10.20.193.91:0/1320258094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5854115120 0x7f58541155c0 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=14021642846167532667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584c00aa40 tx=0x7f584c02fed0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.052 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.058+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/1320258094 shutdown_connections 2026-02-13T01:23:23.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.058+0000 7f585c1eb6c0 1 --2- 10.20.193.91:0/1320258094 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5854115120 0x7f58541155c0 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=14021642846167532667 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.058+0000 7f585c1eb6c0 1 --2- 10.20.193.91:0/1320258094 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58541146f0 0x7f5854114b60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.058+0000 7f585c1eb6c0 1 --2- 10.20.193.91:0/1320258094 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5854113dc0 0x7f58541141b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.058+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/1320258094 >> 10.20.193.91:0/1320258094 conn(0x7f585405b8e0 msgr2=0x7f585405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.062+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/1320258094 shutdown_connections 2026-02-13T01:23:23.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.062+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/1320258094 wait complete. 2026-02-13T01:23:23.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 Processor -- start 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 -- start start 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5854113dc0 0x7f58540fed30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 0x7f58540ff380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5854115120 0x7f58540fff70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5854100670 con 0x7f5854115120 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f58541007e0 con 0x7f5854113dc0 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585c1eb6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f58541009a0 con 0x7f58541146f0 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585975b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 0x7f58540ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585975b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 0x7f58540ff380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:36976/0 (socket says 10.20.193.91:36976) 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.063+0000 7f585975b6c0 1 -- 10.20.193.91:0/2021678136 learned_addr learned my addr 10.20.193.91:0/2021678136 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.064+0000 7f585975b6c0 1 -- 10.20.193.91:0/2021678136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5854113dc0 msgr2=0x7f58540fed30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.064+0000 7f585975b6c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5854113dc0 0x7f58540fed30 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.064+0000 7f585975b6c0 1 -- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5854115120 msgr2=0x7f58540fff70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.064+0000 7f585975b6c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5854115120 0x7f58540fff70 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.064+0000 7f585975b6c0 1 -- 10.20.193.91:0/2021678136 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584c00a660 con 0x7f58541146f0 2026-02-13T01:23:23.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.064+0000 7f585975b6c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 0x7f58540ff380 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584800b6c0 tx=0x7f584800bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.073+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58480044a0 con 0x7f58541146f0 2026-02-13T01:23:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.073+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5848004600 con 0x7f58541146f0 2026-02-13T01:23:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.073+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f584800cd30 con 0x7f58541146f0 2026-02-13T01:23:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.077+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/2021678136 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5854100c80 con 0x7f58541146f0 2026-02-13T01:23:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.077+0000 7f585c1eb6c0 1 -- 10.20.193.91:0/2021678136 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585417a700 con 0x7f58541146f0 2026-02-13T01:23:23.083 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.077+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fb4dc10d1f0 con 0x7fb4dc12de50 2026-02-13T01:23:23.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.083+0000 7fb4c37fe6c0 1 -- 10.20.193.91:0/683503738 <== mon.0 v2:10.20.193.91:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7fb4c4008030 con 0x7fb4dc12de50 2026-02-13T01:23:23.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.081+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5820005310 con 0x7f58541146f0 2026-02-13T01:23:23.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.087+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f5848002770 con 0x7f58541146f0 2026-02-13T01:23:23.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.087+0000 7f5842ffd6c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f582803f870 0x7f582805fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.087+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5848051010 con 0x7f58541146f0 2026-02-13T01:23:23.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.087+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5848051410 con 0x7f58541146f0 2026-02-13T01:23:23.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.090+0000 7f5859f5c6c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f582803f870 0x7f582805fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.090+0000 7f5859f5c6c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f582803f870 0x7f582805fd20 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5850004750 tx=0x7f5850005cc0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.096+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb4b403f7f0 msgr2=0x7fb4b405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.096+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb4b403f7f0 0x7fb4b405fca0 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4d0031fd0 tx=0x7fb4d0005b00 comp rx=0 tx=0).stop 2026-02-13T01:23:23.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.096+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc12de50 msgr2=0x7fb4dc1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.096+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc12de50 0x7fb4dc1095d0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb4c400b6e0 tx=0x7fb4c400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.098 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.101 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.098+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 shutdown_connections 2026-02-13T01:23:23.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.098+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb4b403f7f0 0x7fb4b405fca0 unknown :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.098+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb4dc14e920 0x7fb4dc160410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.098+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb4dc12de50 0x7fb4dc1095d0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.098+0000 7fb4e0f986c0 1 --2- 10.20.193.91:0/683503738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb4dc05f750 0x7fb4dc12d840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.098+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 >> 10.20.193.91:0/683503738 conn(0x7fb4dc0e91f0 msgr2=0x7fb4dc173660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.100+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 shutdown_connections 2026-02-13T01:23:23.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.100+0000 7fb4e0f986c0 1 -- 10.20.193.91:0/683503738 wait complete. 2026-02-13T01:23:23.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.108+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f6154179700 con 0x7f6154113f10 2026-02-13T01:23:23.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.115+0000 7fec0ced46c0 1 -- 10.20.193.91:0/3129659082 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec08134920 msgr2=0x7fec08154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.115+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/3129659082 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec08134920 0x7fec08154da0 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=9244254168051141891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf8008860 tx=0x7febf80311e0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.115 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 -- 10.20.193.91:0/3129659082 shutdown_connections 2026-02-13T01:23:23.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/3129659082 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec081554e0 0x7fec08175990 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/3129659082 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec08134920 0x7fec08154da0 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=9244254168051141891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/3129659082 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec08113f70 0x7fec08134350 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 -- 10.20.193.91:0/3129659082 >> 10.20.193.91:0/3129659082 conn(0x7fec0805b8e0 msgr2=0x7fec0805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.127 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7f6150ff96c0 1 -- 10.20.193.91:0/3798379122 <== mon.1 v2:10.20.193.154:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f614403a030 con 0x7f6154113f10 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.122+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f612803f820 msgr2=0x7f612805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.122+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f612803f820 0x7f612805fcd0 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6140006fd0 tx=0x7f6140009190 comp rx=0 tx=0).stop 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.122+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 msgr2=0x7f6154175870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.122+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6144005ae0 tx=0x7f6144002960 comp rx=0 tx=0).stop 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.124+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 shutdown_connections 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.124+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f612803f820 0x7f612805fcd0 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.124+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61541147f0 0x7f61540ff200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.124+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6154113f10 0x7f6154175870 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.124+0000 7f6159db16c0 1 --2- 10.20.193.91:0/3798379122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6154113560 0x7f61540fe9a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.124+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 >> 10.20.193.91:0/3798379122 conn(0x7f6154064300 msgr2=0x7f61540f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.125+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 shutdown_connections 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.125+0000 7f6159db16c0 1 -- 10.20.193.91:0/3798379122 wait complete. 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 -- 10.20.193.91:0/3129659082 shutdown_connections 2026-02-13T01:23:23.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.117+0000 7fec0ced46c0 1 -- 10.20.193.91:0/3129659082 wait complete. 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 Processor -- start 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 -- start start 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec08113f70 0x7fec08175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec08134920 0x7fec08154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 0x7fec0811ced0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fec0811d660 con 0x7fec081554e0 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fec0811d7a0 con 0x7fec08113f70 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.118+0000 7fec0ced46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec0811de30 con 0x7fec08134920 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 0x7fec0811ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 0x7fec0811ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51756/0 (socket says 10.20.193.91:51756) 2026-02-13T01:23:23.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 -- 10.20.193.91:0/1559040191 learned_addr learned my addr 10.20.193.91:0/1559040191 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec065756c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec08113f70 0x7fec08175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 -- 10.20.193.91:0/1559040191 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec08134920 msgr2=0x7fec08154d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec08134920 0x7fec08154d40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 -- 10.20.193.91:0/1559040191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec08113f70 msgr2=0x7fec08175970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec08113f70 0x7fec08175970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.119+0000 7fec06d766c0 1 -- 10.20.193.91:0/1559040191 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf8008220 con 0x7fec081554e0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.120+0000 7fec06d766c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 0x7fec0811ced0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febfc009fd0 tx=0x7febfc00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.125+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febfc0044a0 con 0x7fec081554e0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.125+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0811e110 con 0x7fec081554e0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.125+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0811e5f0 con 0x7fec081554e0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.125+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7febfc004600 con 0x7fec081554e0 2026-02-13T01:23:23.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.126+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec08179960 con 0x7fec081554e0 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.126+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febfc00cc00 con 0x7fec081554e0 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.126+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7febfc00e070 con 0x7fec081554e0 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.126+0000 7febef7fe6c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7febe803f870 0x7febe805fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.126+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7febfc051f20 con 0x7fec081554e0 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.127+0000 7fec065756c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7febe803f870 0x7febe805fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.127+0000 7fec065756c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7febe803f870 0x7febe805fd20 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf0006fd0 tx=0x7febf0009190 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.130+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7febfc00cd90 con 0x7fec081554e0 2026-02-13T01:23:23.140 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.140 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.159 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.164+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fc43c0055c0 con 0x7fc4781554e0 2026-02-13T01:23:23.172 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.169+0000 7fc45f7fe6c0 1 -- 10.20.193.91:0/2019957873 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7fc470012820 con 0x7fc4781554e0 2026-02-13T01:23:23.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.173+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc45003f820 msgr2=0x7fc45005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.173+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc45003f820 0x7fc45005fcd0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4600098c0 tx=0x7fc460005c40 comp rx=0 tx=0).stop 2026-02-13T01:23:23.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.174+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 msgr2=0x7fc4780fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.174+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 0x7fc4780fcd40 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc47000c6c0 tx=0x7fc47000cb90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 shutdown_connections 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc45003f820 0x7fc45005fcd0 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc4781554e0 0x7fc4780fcd40 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc478134920 0x7fc478154d80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 --2- 10.20.193.91:0/2019957873 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc478113f70 0x7fc478175970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 >> 10.20.193.91:0/2019957873 conn(0x7fc47805b8e0 msgr2=0x7fc478113240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 shutdown_connections 2026-02-13T01:23:23.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.175+0000 7fc47cfe06c0 1 -- 10.20.193.91:0/2019957873 wait complete. 2026-02-13T01:23:23.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.180+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/1081415280 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 msgr2=0x7f7a2c10e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.180+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/1081415280 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c10e060 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=8727257978980263943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a14009b00 tx=0x7f7a1402eeb0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/1081415280 shutdown_connections 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/1081415280 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c16ef30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/1081415280 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c10e060 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=8727257978980263943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/1081415280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10ca70 0x7f7a2c10ce60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/1081415280 >> 10.20.193.91:0/1081415280 conn(0x7f7a2c0ea190 msgr2=0x7f7a2c10a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/1081415280 shutdown_connections 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/1081415280 wait complete. 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 Processor -- start 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.181+0000 7f7a2b5776c0 1 -- start start 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2b5776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7a2c10ca70 0x7f7a2c0f8240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2b5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c16ef30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2b5776c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c0f8aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2b5776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c0f96d0 con 0x7f7a2c10dbf0 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2b5776c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c0f9840 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2b5776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c0f9a00 con 0x7f7a2c10ca70 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c0f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c0f8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:50498/0 (socket says 10.20.193.91:50498) 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 -- 10.20.193.91:0/3301541667 learned_addr learned my addr 10.20.193.91:0/3301541667 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2a5756c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7a2c10ca70 0x7f7a2c0f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a29d746c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c16ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 -- 10.20.193.91:0/3301541667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7a2c10ca70 msgr2=0x7f7a2c0f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7a2c10ca70 0x7f7a2c0f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 -- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 msgr2=0x7f7a2c16ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c16ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 -- 10.20.193.91:0/3301541667 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a20009590 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a29d746c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c16ef30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a2ad766c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c0f8aa0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a1c00c6c0 tx=0x7f7a1c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a1c003c40 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.182+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7a1c00a030 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.183+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a1c00db70 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.183+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a140094c0 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.183+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2c0f9fb0 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.184+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f7a1c00dd00 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.184+0000 7f7a137fe6c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a0403f820 0x7f7a0405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.184+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f7a1c052100 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.185+0000 7f7a2a5756c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a0403f820 0x7f7a0405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.185+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2c172eb0 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.185+0000 7f7a2a5756c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a0403f820 0x7f7a0405fcd0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a20005fd0 tx=0x7f7a20009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.187+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7a1c008550 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/415547145 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 msgr2=0x7fbd2410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 --2- 10.20.193.91:0/415547145 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd2410f2c0 secure :-1 s=READY pgs=110 gs=3 cs=0 l=1 c_cookie=3796127645316232420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd1800aa40 tx=0x7fbd1802fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/415547145 shutdown_connections 2026-02-13T01:23:23.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 --2- 10.20.193.91:0/415547145 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd24110a00 0x7fbd24171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 --2- 10.20.193.91:0/415547145 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24110050 0x7fbd241104c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 --2- 10.20.193.91:0/415547145 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd2410f2c0 unknown :-1 s=CLOSED pgs=110 gs=3 cs=0 l=1 c_cookie=3796127645316232420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/415547145 >> 10.20.193.91:0/415547145 conn(0x7fbd240ec5f0 msgr2=0x7fbd2410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/415547145 shutdown_connections 2026-02-13T01:23:23.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.191+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/415547145 wait complete. 2026-02-13T01:23:23.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.192+0000 7fbd2a5636c0 1 Processor -- start 2026-02-13T01:23:23.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.192+0000 7fbd2a5636c0 1 -- start start 2026-02-13T01:23:23.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.192+0000 7fbd2a5636c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd24100fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd24110050 0x7fbd24171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24110a00 0x7fbd24101830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24102460 con 0x7fbd2410eed0 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbd241025d0 con 0x7fbd24110a00 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24102790 con 0x7fbd24110050 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd24100fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd24100fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51800/0 (socket says 10.20.193.91:51800) 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 -- 10.20.193.91:0/1255211260 learned_addr learned my addr 10.20.193.91:0/1255211260 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 -- 10.20.193.91:0/1255211260 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd24110050 msgr2=0x7fbd24171390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd24110050 0x7fbd24171390 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 -- 10.20.193.91:0/1255211260 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24110a00 msgr2=0x7fbd24101830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24110a00 0x7fbd24101830 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 -- 10.20.193.91:0/1255211260 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1800a660 con 0x7fbd2410eed0 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd23fff6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd24100fd0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd180024b0 tx=0x7fbd1803bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd18039e20 con 0x7fbd2410eed0 2026-02-13T01:23:23.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/1255211260 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd24102a10 con 0x7fbd2410eed0 2026-02-13T01:23:23.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbd18005740 con 0x7fbd2410eed0 2026-02-13T01:23:23.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.193+0000 7fbd2a5636c0 1 -- 10.20.193.91:0/1255211260 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd24102ee0 con 0x7fbd2410eed0 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.194+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd18039e20 con 0x7fbd2410eed0 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.194+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce4005310 con 0x7fbd2410eed0 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.195+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fbd18003810 con 0x7fbd2410eed0 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.195+0000 7fbd217fa6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbcf803f8e0 0x7fbcf805fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.195+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fbd1803c040 con 0x7fbd2410eed0 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.195+0000 7fbd237fe6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbcf803f8e0 0x7fbcf805fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.195+0000 7fbd237fe6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbcf803f8e0 0x7fbcf805fd90 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd10004750 tx=0x7fbd100093b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.197+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbd180085f0 con 0x7fbd2410eed0 2026-02-13T01:23:23.203 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.203 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 -- 10.20.193.91:0/2267662133 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010bf90 msgr2=0x7f822010c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2267662133 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010bf90 0x7f822010c400 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=8114544065437578744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8208009970 tx=0x7f820802ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:23.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 -- 10.20.193.91:0/2267662133 shutdown_connections 2026-02-13T01:23:23.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2267662133 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010c940 0x7f822016d2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2267662133 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010bf90 0x7f822010c400 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=8114544065437578744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2267662133 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f822010ae10 0x7f822010b200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 -- 10.20.193.91:0/2267662133 >> 10.20.193.91:0/2267662133 conn(0x7f82200e8510 msgr2=0x7f8220108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 -- 10.20.193.91:0/2267662133 shutdown_connections 2026-02-13T01:23:23.207 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.206+0000 7f8224df96c0 1 -- 10.20.193.91:0/2267662133 wait complete. 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 Processor -- start 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 -- start start 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010ae10 0x7f8220174aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 0x7f822016d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f821e5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010ae10 0x7f8220174aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f821dd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 0x7f822016d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f821e5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010ae10 0x7f8220174aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:37034/0 (socket says 10.20.193.91:37034) 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f821dd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 0x7f822016d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51828/0 (socket says 10.20.193.91:51828) 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f822010c940 0x7f82201752e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f821dd746c0 1 -- 10.20.193.91:0/2268745143 learned_addr learned my addr 10.20.193.91:0/2268745143 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8220175f30 con 0x7f822010bf90 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f82201760a0 con 0x7f822010c940 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.207+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8220176260 con 0x7f822010ae10 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f821dd746c0 1 -- 10.20.193.91:0/2268745143 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010ae10 msgr2=0x7f8220174aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f821dd746c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010ae10 0x7f8220174aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f821dd746c0 1 -- 10.20.193.91:0/2268745143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f822010c940 msgr2=0x7f82201752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f821dd746c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f822010c940 0x7f82201752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f821dd746c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821000a5b0 con 0x7f822010bf90 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f821dd746c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 0x7f822016d2b0 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82080092e0 tx=0x7f8208002730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8208002c00 con 0x7f822010bf90 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8208002d60 con 0x7f822010bf90 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f82080362f0 con 0x7f822010bf90 2026-02-13T01:23:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.208+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8208009590 con 0x7f822010bf90 2026-02-13T01:23:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.209+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f820803a070 con 0x7f822010bf90 2026-02-13T01:23:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.209+0000 7f82077fe6c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81f803f870 0x7f81f805fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.210+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8220176660 con 0x7f822010bf90 2026-02-13T01:23:23.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.210+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f820803ae20 con 0x7f822010bf90 2026-02-13T01:23:23.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.211+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e4005310 con 0x7f822010bf90 2026-02-13T01:23:23.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.211+0000 7f821e5756c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81f803f870 0x7f81f805fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.212+0000 7f821e5756c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81f803f870 0x7f81f805fd20 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8214004750 tx=0x7f8214009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.215+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8208035260 con 0x7f822010bf90 2026-02-13T01:23:23.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.227+0000 7ff173d006c0 1 -- 10.20.193.91:0/4001141297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c134920 msgr2=0x7ff16c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.227+0000 7ff173d006c0 1 --2- 10.20.193.91:0/4001141297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c134920 0x7ff16c154da0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=178367133438723314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff164009610 tx=0x7ff164038810 comp rx=0 tx=0).stop 2026-02-13T01:23:23.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 -- 10.20.193.91:0/4001141297 shutdown_connections 2026-02-13T01:23:23.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 --2- 10.20.193.91:0/4001141297 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff16c1554e0 0x7ff16c175990 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 --2- 10.20.193.91:0/4001141297 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c134920 0x7ff16c154da0 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=178367133438723314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 --2- 10.20.193.91:0/4001141297 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff16c113f70 0x7ff16c134350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 -- 10.20.193.91:0/4001141297 >> 10.20.193.91:0/4001141297 conn(0x7ff16c05b8e0 msgr2=0x7ff16c05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 -- 10.20.193.91:0/4001141297 shutdown_connections 2026-02-13T01:23:23.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 -- 10.20.193.91:0/4001141297 wait complete. 2026-02-13T01:23:23.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.228+0000 7ff173d006c0 1 Processor -- start 2026-02-13T01:23:23.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 -- start start 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 0x7ff16c175970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff16c134920 0x7ff16c154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 0x7ff16c175970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 0x7ff16c175970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51842/0 (socket says 10.20.193.91:51842) 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff16c1554e0 0x7ff16c113450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c113be0 con 0x7ff16c113f70 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 -- 10.20.193.91:0/1670426558 learned_addr learned my addr 10.20.193.91:0/1670426558 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c111ed0 con 0x7ff16c1554e0 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff173d006c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff16c112090 con 0x7ff16c134920 2026-02-13T01:23:23.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 -- 10.20.193.91:0/1670426558 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff16c134920 msgr2=0x7ff16c154d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff16c134920 0x7ff16c154d40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 -- 10.20.193.91:0/1670426558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff16c1554e0 msgr2=0x7ff16c113450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff1722766c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff16c1554e0 0x7ff16c113450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff16c1554e0 0x7ff16c113450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff164009230 con 0x7ff16c113f70 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.229+0000 7ff171a756c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 0x7ff16c175970 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16000c7f0 tx=0x7ff16000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.230+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff160004a80 con 0x7ff16c113f70 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.230+0000 7ff173d006c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16c112370 con 0x7ff16c113f70 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.230+0000 7ff173d006c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16c112850 con 0x7ff16c113f70 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.230+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff160009030 con 0x7ff16c113f70 2026-02-13T01:23:23.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.230+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff160005490 con 0x7ff16c113f70 2026-02-13T01:23:23.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.231+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7ff160005660 con 0x7ff16c113f70 2026-02-13T01:23:23.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.231+0000 7ff15affd6c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff14803f820 0x7ff14805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.232+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7ff1600522d0 con 0x7ff16c113f70 2026-02-13T01:23:23.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.232+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff134005310 con 0x7ff16c113f70 2026-02-13T01:23:23.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.232+0000 7ff1712746c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff14803f820 0x7ff14805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.236+0000 7ff1712746c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff14803f820 0x7ff14805fcd0 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff164009610 tx=0x7ff164038fd0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.236+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff16000f2b0 con 0x7ff16c113f70 2026-02-13T01:23:23.243 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.249 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.262 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.271 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.275+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f58200055c0 con 0x7f58541146f0 2026-02-13T01:23:23.274 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.278+0000 7f5842ffd6c0 1 -- 10.20.193.91:0/2021678136 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f5848011910 con 0x7f58541146f0 2026-02-13T01:23:23.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 -- 10.20.193.91:0/1139373688 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410ddb0 msgr2=0x7efce410e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 --2- 10.20.193.91:0/1139373688 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410ddb0 0x7efce410e220 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=3575134412455747426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd4009970 tx=0x7efcd402ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:23.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 -- 10.20.193.91:0/1139373688 shutdown_connections 2026-02-13T01:23:23.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 --2- 10.20.193.91:0/1139373688 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410e760 0x7efce416f0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 --2- 10.20.193.91:0/1139373688 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410ddb0 0x7efce410e220 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=3575134412455747426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 --2- 10.20.193.91:0/1139373688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce410cc30 0x7efce410d020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.282+0000 7efcec7086c0 1 -- 10.20.193.91:0/1139373688 >> 10.20.193.91:0/1139373688 conn(0x7efce40ea330 msgr2=0x7efce410a760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.283+0000 7efcec7086c0 1 -- 10.20.193.91:0/1139373688 shutdown_connections 2026-02-13T01:23:23.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.283+0000 7efcec7086c0 1 -- 10.20.193.91:0/1139373688 wait complete. 2026-02-13T01:23:23.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.283+0000 7efcec7086c0 1 Processor -- start 2026-02-13T01:23:23.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.283+0000 7efcec7086c0 1 -- start start 2026-02-13T01:23:23.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.284+0000 7efcec7086c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce410cc30 0x7efce4061ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.284+0000 7efcec7086c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 0x7efce4062330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.284+0000 7efce9c786c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 0x7efce4062330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.284+0000 7efce9c786c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 0x7efce4062330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51858/0 (socket says 10.20.193.91:51858) 2026-02-13T01:23:23.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 -- 10.20.193.91:0/665987765 learned_addr learned my addr 10.20.193.91:0/665987765 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410e760 0x7efce40607f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7efce4060f80 con 0x7efce410ddb0 2026-02-13T01:23:23.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efce40610f0 con 0x7efce410cc30 2026-02-13T01:23:23.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7efce40612b0 con 0x7efce410e760 2026-02-13T01:23:23.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f582803f870 msgr2=0x7f582805fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7f5840ff96c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f582803f870 0x7f582805fd20 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5850004750 tx=0x7f5850005cc0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 msgr2=0x7f58540ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7f5840ff96c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 0x7f58540ff380 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f584800b6c0 tx=0x7f584800bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efcea4796c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce410cc30 0x7efce4061ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 -- 10.20.193.91:0/665987765 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410e760 msgr2=0x7efce40607f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410e760 0x7efce40607f0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 -- 10.20.193.91:0/665987765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce410cc30 msgr2=0x7efce4061ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce410cc30 0x7efce4061ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd4009590 con 0x7efce410ddb0 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.285+0000 7efce9c786c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 0x7efce4062330 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd40023e0 tx=0x7efcd4002cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcd40073e0 con 0x7efce410ddb0 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efcd402fd50 con 0x7efce410ddb0 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efcd4038460 con 0x7efce410ddb0 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.286+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce40fea90 con 0x7efce410ddb0 2026-02-13T01:23:23.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.287+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce40fee00 con 0x7efce410ddb0 2026-02-13T01:23:23.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.288+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7efcd4007540 con 0x7efce410ddb0 2026-02-13T01:23:23.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.288+0000 7efccb7fe6c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efcc003f870 0x7efcc005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.288+0000 7f51670e76c0 1 -- 10.20.193.91:0/1350365071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5160110830 msgr2=0x7f51601711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7f51670e76c0 1 --2- 10.20.193.91:0/1350365071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5160110830 0x7f51601711c0 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=10425245746107777930 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c02fd20 comp rx=0 tx=0).stop 2026-02-13T01:23:23.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7f51670e76c0 1 -- 10.20.193.91:0/1350365071 shutdown_connections 2026-02-13T01:23:23.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7f51670e76c0 1 --2- 10.20.193.91:0/1350365071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5160110830 0x7f51601711c0 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=10425245746107777930 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7f51670e76c0 1 --2- 10.20.193.91:0/1350365071 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f516010fe80 0x7f51601102f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.288+0000 7efcea4796c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efcc003f870 0x7efcc005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7efcea4796c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efcc003f870 0x7efcc005fd20 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd8005980 tx=0x7efcd8005d20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7efcd407a550 con 0x7efce410ddb0 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7f51670e76c0 1 --2- 10.20.193.91:0/1350365071 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 0x7f516010f0f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.289+0000 7f51670e76c0 1 -- 10.20.193.91:0/1350365071 >> 10.20.193.91:0/1350365071 conn(0x7f51600ec400 msgr2=0x7f516010c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.290+0000 7f51670e76c0 1 -- 10.20.193.91:0/1350365071 shutdown_connections 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.290+0000 7f51670e76c0 1 -- 10.20.193.91:0/1350365071 wait complete. 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7f51670e76c0 1 Processor -- start 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7f51670e76c0 1 -- start start 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7f51670e76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 0x7f51600f83c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7f51670e76c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f516010fe80 0x7f51601711c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7f51660e56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 0x7f51600f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7f51660e56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 0x7f51600f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51880/0 (socket says 10.20.193.91:51880) 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51660e56c0 1 -- 10.20.193.91:0/2142803646 learned_addr learned my addr 10.20.193.91:0/2142803646 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5160110830 0x7f51600f8c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51658e46c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f516010fe80 0x7f51601711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f51600f9850 con 0x7f516010ed00 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f51600f99c0 con 0x7f516010fe80 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51600f9b80 con 0x7f5160110830 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5160110830 0x7f51600f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.291+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce4173000 con 0x7efce410ddb0 2026-02-13T01:23:23.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 -- 10.20.193.91:0/2142803646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f516010fe80 msgr2=0x7f51601711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f516010fe80 0x7f51601711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 -- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 msgr2=0x7f51600f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 0x7f51600f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5154009590 con 0x7f5160110830 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f51668e66c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5160110830 0x7f51600f8c20 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f515c030a90 tx=0x7f515c0307b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 shutdown_connections 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f582803f870 0x7f582805fd20 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5854115120 0x7f58540fff70 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f58541146f0 0x7f58540ff380 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 --2- 10.20.193.91:0/2021678136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5854113dc0 0x7f58540fed30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 >> 10.20.193.91:0/2021678136 conn(0x7f585405b8e0 msgr2=0x7f58540f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 shutdown_connections 2026-02-13T01:23:23.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f5840ff96c0 1 -- 10.20.193.91:0/2021678136 wait complete. 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.292+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f515c003c40 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f515c003da0 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f515c037410 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c00a5b0 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.293+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51600f9fe0 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.294+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51601750d0 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.294+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f515c0375a0 con 0x7f5160110830 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.294+0000 7f514f7fe6c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f513803f820 0x7f513805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.294+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f515c0774b0 con 0x7f5160110830 2026-02-13T01:23:23.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.294+0000 7f51660e56c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f513803f820 0x7f513805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.294+0000 7f51660e56c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f513803f820 0x7f513805fcd0 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5154005b40 tx=0x7f5154009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.295+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efcd40056c0 con 0x7efce410ddb0 2026-02-13T01:23:23.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.296+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f515c035270 con 0x7f5160110830 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/3845451684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 msgr2=0x7f326c1104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/3845451684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 0x7f326c1104c0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=7526319982919862366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3254009bd0 tx=0x7f325402ef90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/3845451684 shutdown_connections 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/3845451684 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f326c110a00 0x7f326c171390 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/3845451684 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 0x7f326c1104c0 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=7526319982919862366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/3845451684 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c10f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.297+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/3845451684 >> 10.20.193.91:0/3845451684 conn(0x7f326c0ec5f0 msgr2=0x7f326c10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.298+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fec08179b40 con 0x7fec081554e0 2026-02-13T01:23:23.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.298+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/3845451684 shutdown_connections 2026-02-13T01:23:23.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.298+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/3845451684 wait complete. 2026-02-13T01:23:23.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.298+0000 7f3270f0c6c0 1 Processor -- start 2026-02-13T01:23:23.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.298+0000 7f3270f0c6c0 1 -- start start 2026-02-13T01:23:23.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.299+0000 7f3270f0c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c0f8500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.299+0000 7f3270f0c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 0x7f326c171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.299+0000 7f326a5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c0f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.299+0000 7f326a5756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c0f8500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:37110/0 (socket says 10.20.193.91:37110) 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326a5756c0 1 -- 10.20.193.91:0/730516534 learned_addr learned my addr 10.20.193.91:0/730516534 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f3269d746c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 0x7f326c171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f326c110a00 0x7f326c0f8d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f326c0f9990 con 0x7f326c110050 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f326c0f9b00 con 0x7f326c110a00 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f326c0f9cc0 con 0x7f326c10eed0 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326ad766c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f326c110a00 0x7f326c0f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326a5756c0 1 -- 10.20.193.91:0/730516534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f326c110a00 msgr2=0x7f326c0f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326a5756c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f326c110a00 0x7f326c0f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326a5756c0 1 -- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 msgr2=0x7f326c171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326a5756c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 0x7f326c171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.300+0000 7f326a5756c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3254009590 con 0x7f326c10eed0 2026-02-13T01:23:23.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.301+0000 7f326a5756c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c0f8500 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3260009490 tx=0x7f326000bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.301+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3260004a80 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.301+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3260009030 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.302+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f326000ce30 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.302+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f326c0f9fa0 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.302+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f326c0fa3a0 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.303+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f3260004060 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.303+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f326c175340 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.303+0000 7f32537fe6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f324403f7f0 0x7f324405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.303+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3260051200 con 0x7f326c10eed0 2026-02-13T01:23:23.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.302+0000 7febef7fe6c0 1 -- 10.20.193.91:0/1559040191 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7febfc00f3b0 con 0x7fec081554e0 2026-02-13T01:23:23.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.303+0000 7f3269d746c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f324403f7f0 0x7f324405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.306+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3260003020 con 0x7f326c10eed0 2026-02-13T01:23:23.305 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7febe803f870 msgr2=0x7febe805fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7febe803f870 0x7febe805fd20 secure :-1 s=READY pgs=19 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febf0006fd0 tx=0x7febf0009190 comp rx=0 tx=0).stop 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 msgr2=0x7fec0811ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 0x7fec0811ced0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febfc009fd0 tx=0x7febfc00b930 comp rx=0 tx=0).stop 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 shutdown_connections 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7febe803f870 0x7febe805fd20 unknown :-1 s=CLOSED pgs=19 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fec081554e0 0x7fec0811ced0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.308+0000 7f45795446c0 1 -- 10.20.193.91:0/3904936271 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 msgr2=0x7f457416f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.308+0000 7f45795446c0 1 --2- 10.20.193.91:0/3904936271 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 0x7f457416f110 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=820500147466457492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f456400aa40 tx=0x7f456402fe10 comp rx=0 tx=0).stop 2026-02-13T01:23:23.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7f45795446c0 1 -- 10.20.193.91:0/3904936271 shutdown_connections 2026-02-13T01:23:23.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.310+0000 7f45795446c0 1 --2- 10.20.193.91:0/3904936271 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 0x7f457416f110 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=820500147466457492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.310+0000 7f45795446c0 1 --2- 10.20.193.91:0/3904936271 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f457410ddd0 0x7f457410e240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.310+0000 7f45795446c0 1 --2- 10.20.193.91:0/3904936271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f457410d040 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.310+0000 7f45795446c0 1 -- 10.20.193.91:0/3904936271 >> 10.20.193.91:0/3904936271 conn(0x7f45740ea370 msgr2=0x7f457410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.310+0000 7f45795446c0 1 -- 10.20.193.91:0/3904936271 shutdown_connections 2026-02-13T01:23:23.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.311+0000 7f45795446c0 1 -- 10.20.193.91:0/3904936271 wait complete. 2026-02-13T01:23:23.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fec08134920 0x7fec08154d40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 --2- 10.20.193.91:0/1559040191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec08113f70 0x7fec08175970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.309+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 >> 10.20.193.91:0/1559040191 conn(0x7fec0805b8e0 msgr2=0x7fec0817c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.311+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 shutdown_connections 2026-02-13T01:23:23.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.312+0000 7f45795446c0 1 Processor -- start 2026-02-13T01:23:23.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.312+0000 7f45795446c0 1 -- start start 2026-02-13T01:23:23.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.312+0000 7f45795446c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f45740f6300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.312+0000 7fec0ced46c0 1 -- 10.20.193.91:0/1559040191 wait complete. 2026-02-13T01:23:23.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.313+0000 7f3269d746c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f324403f7f0 0x7f324405fca0 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3254005980 tx=0x7f3254005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.313+0000 7f45795446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f457410ddd0 0x7f457416f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.314+0000 7f45795446c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 0x7f45740f6b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.314+0000 7f45795446c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f45740f7790 con 0x7f457410e780 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.314+0000 7f45795446c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45740f7900 con 0x7f457410cc50 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.314+0000 7f45795446c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45740f7ac0 con 0x7f457410ddd0 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f45740f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f45740f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:50624/0 (socket says 10.20.193.91:50624) 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 -- 10.20.193.91:0/4055239491 learned_addr learned my addr 10.20.193.91:0/4055239491 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 -- 10.20.193.91:0/4055239491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f457410ddd0 msgr2=0x7f457416f110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f457410ddd0 0x7f457416f110 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 -- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 msgr2=0x7f45740f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 0x7f45740f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.315+0000 7f4572ffd6c0 1 -- 10.20.193.91:0/4055239491 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456400a660 con 0x7f457410cc50 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.316+0000 7f4572ffd6c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f45740f6300 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f456800b6c0 tx=0x7f456800bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.316+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45680044a0 con 0x7f457410cc50 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.316+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4568004600 con 0x7f457410cc50 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.316+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45740f7da0 con 0x7f457410cc50 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.316+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f456800ccc0 con 0x7f457410cc50 2026-02-13T01:23:23.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.316+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45740f8280 con 0x7f457410cc50 2026-02-13T01:23:23.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.317+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4574170e50 con 0x7f457410cc50 2026-02-13T01:23:23.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f4568002750 con 0x7f457410cc50 2026-02-13T01:23:23.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.317+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/1866116770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110050 msgr2=0x7f3c181104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.317+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/1866116770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110050 0x7f3c181104c0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=13309345374474801104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c0c009970 tx=0x7f3c0c02ed70 comp rx=0 tx=0).stop 2026-02-13T01:23:23.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/1866116770 shutdown_connections 2026-02-13T01:23:23.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/1866116770 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c18110a00 0x7f3c18171390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/1866116770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110050 0x7f3c181104c0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=13309345374474801104 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/1866116770 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 0x7f3c1810f2c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/1866116770 >> 10.20.193.91:0/1866116770 conn(0x7f3c180ec5f0 msgr2=0x7f3c1810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/1866116770 shutdown_connections 2026-02-13T01:23:23.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/1866116770 wait complete. 2026-02-13T01:23:23.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f4553fff6c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f454c03f820 0x7f454c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.318+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4568050fe0 con 0x7f457410cc50 2026-02-13T01:23:23.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.319+0000 7f45727fc6c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f454c03f820 0x7f454c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.319+0000 7f45727fc6c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f454c03f820 0x7f454c05fcd0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f455c004750 tx=0x7f455c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.319+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f456800f870 con 0x7f457410cc50 2026-02-13T01:23:23.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.319+0000 7f3c1f6906c0 1 Processor -- start 2026-02-13T01:23:23.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.319+0000 7f3c1f6906c0 1 -- start start 2026-02-13T01:23:23.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1f6906c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 0x7f3c180f8620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1f6906c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c18110050 0x7f3c18171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1f6906c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110a00 0x7f3c180f8e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1d4016c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 0x7f3c180f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1d4016c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 0x7f3c180f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:37138/0 (socket says 10.20.193.91:37138) 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1d4016c0 1 -- 10.20.193.91:0/4257576921 learned_addr learned my addr 10.20.193.91:0/4257576921 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180f9ab0 con 0x7f3c18110050 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180f9c20 con 0x7f3c18110a00 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c180f9de0 con 0x7f3c1810eed0 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.320+0000 7f3c1dc026c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110a00 0x7f3c180f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c1dc026c0 1 -- 10.20.193.91:0/4257576921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 msgr2=0x7f3c180f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c1dc026c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 0x7f3c180f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c1dc026c0 1 -- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c18110050 msgr2=0x7f3c18171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c1dc026c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c18110050 0x7f3c18171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c1dc026c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c009590 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c1dc026c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110a00 0x7f3c180f8e80 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c1400c4b0 tx=0x7f3c1400c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c140054a0 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.321+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3c14005600 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.322+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c1400dc50 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.322+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c180fa0c0 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.322+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c180fa540 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.322+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f3c14003810 con 0x7f3c18110a00 2026-02-13T01:23:23.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.323+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c18175370 con 0x7f3c18110a00 2026-02-13T01:23:23.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.323+0000 7f3c067fc6c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3bf403f820 0x7f3bf405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.323+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3c14051f90 con 0x7f3c18110a00 2026-02-13T01:23:23.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.325+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3c1400de20 con 0x7f3c18110a00 2026-02-13T01:23:23.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.326+0000 7f3c1d4016c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3bf403f820 0x7f3bf405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.327+0000 7f3c1d4016c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3bf403f820 0x7f3bf405fcd0 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c08006f40 tx=0x7f3c08009210 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.334+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f79f00051e0 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.346+0000 7f7a137fe6c0 1 -- 10.20.193.91:0/3301541667 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f7a1c008550 con 0x7f7a2c10e5a0 2026-02-13T01:23:23.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.351+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a0403f820 msgr2=0x7f7a0405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.351+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a0403f820 0x7f7a0405fcd0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a20005fd0 tx=0x7f7a20009310 comp rx=0 tx=0).stop 2026-02-13T01:23:23.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.351+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 msgr2=0x7f7a2c0f8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.351+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c0f8aa0 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a1c00c6c0 tx=0x7f7a1c00cb90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.353+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 shutdown_connections 2026-02-13T01:23:23.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.353+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a0403f820 0x7f7a0405fcd0 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.353+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7a2c10e5a0 0x7f7a2c0f8aa0 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.353+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7a2c10dbf0 0x7f7a2c16ef30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.353+0000 7f7a2b5776c0 1 --2- 10.20.193.91:0/3301541667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7a2c10ca70 0x7f7a2c0f8240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.353+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 >> 10.20.193.91:0/3301541667 conn(0x7f7a2c0ea190 msgr2=0x7f7a2c060fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.355+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 shutdown_connections 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.356+0000 7f7a2b5776c0 1 -- 10.20.193.91:0/3301541667 wait complete. 2026-02-13T01:23:23.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.356+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fbce40055c0 con 0x7fbd2410eed0 2026-02-13T01:23:23.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.359+0000 7fbd217fa6c0 1 -- 10.20.193.91:0/1255211260 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7fbd180085f0 con 0x7fbd2410eed0 2026-02-13T01:23:23.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.365+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbcf803f8e0 msgr2=0x7fbcf805fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.365+0000 7fbcfeffd6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbcf803f8e0 0x7fbcf805fd90 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd10004750 tx=0x7fbd100093b0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.365+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 msgr2=0x7fbd24100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.365+0000 7fbcfeffd6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd24100fd0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd180024b0 tx=0x7fbd1803bd30 comp rx=0 tx=0).stop 2026-02-13T01:23:23.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.366+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 shutdown_connections 2026-02-13T01:23:23.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.366+0000 7fbcfeffd6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbcf803f8e0 0x7fbcf805fd90 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.366+0000 7fbcfeffd6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24110a00 0x7fbd24101830 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.366+0000 7fbcfeffd6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd24110050 0x7fbd24171390 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.366+0000 7fbcfeffd6c0 1 --2- 10.20.193.91:0/1255211260 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd2410eed0 0x7fbd24100fd0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.366+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 >> 10.20.193.91:0/1255211260 conn(0x7fbd240ec5f0 msgr2=0x7fbd240561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.369+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 shutdown_connections 2026-02-13T01:23:23.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.369+0000 7fbcfeffd6c0 1 -- 10.20.193.91:0/1255211260 wait complete. 2026-02-13T01:23:23.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.381+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f81e4005b40 con 0x7f822010bf90 2026-02-13T01:23:23.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.386+0000 7f82077fe6c0 1 -- 10.20.193.91:0/2268745143 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f8208031030 con 0x7f822010bf90 2026-02-13T01:23:23.395 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.392+0000 7f11c82486c0 1 -- 10.20.193.91:0/1040563536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c01146f0 msgr2=0x7f11c0114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.392+0000 7f11c82486c0 1 --2- 10.20.193.91:0/1040563536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c01146f0 0x7f11c0114b60 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=15031574143897244837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b001ad80 tx=0x7f11b0040220 comp rx=0 tx=0).stop 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 -- 10.20.193.91:0/1040563536 shutdown_connections 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 --2- 10.20.193.91:0/1040563536 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c0115120 0x7f11c01155c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 --2- 10.20.193.91:0/1040563536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c01146f0 0x7f11c0114b60 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=15031574143897244837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 --2- 10.20.193.91:0/1040563536 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c01141b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 -- 10.20.193.91:0/1040563536 >> 10.20.193.91:0/1040563536 conn(0x7f11c005b8e0 msgr2=0x7f11c005bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 -- 10.20.193.91:0/1040563536 shutdown_connections 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f11c82486c0 1 -- 10.20.193.91:0/1040563536 wait complete. 2026-02-13T01:23:23.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.392+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81f803f870 msgr2=0x7f81f805fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.392+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81f803f870 0x7f81f805fd20 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8214004750 tx=0x7f8214009260 comp rx=0 tx=0).stop 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.392+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 msgr2=0x7f822016d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.392+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 0x7f822016d2b0 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82080092e0 tx=0x7f8208002730 comp rx=0 tx=0).stop 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 shutdown_connections 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81f803f870 0x7f81f805fd20 unknown :-1 s=CLOSED pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f822010c940 0x7f82201752e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f822010bf90 0x7f822016d2b0 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 --2- 10.20.193.91:0/2268745143 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f822010ae10 0x7f8220174aa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 >> 10.20.193.91:0/2268745143 conn(0x7f82200e8510 msgr2=0x7f82200561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 shutdown_connections 2026-02-13T01:23:23.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.393+0000 7f8224df96c0 1 -- 10.20.193.91:0/2268745143 wait complete. 2026-02-13T01:23:23.398 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.395+0000 7f11c82486c0 1 Processor -- start 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.395+0000 7f11c82486c0 1 -- start start 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.395+0000 7f11c82486c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c00fed50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.395+0000 7f11c82486c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c01146f0 0x7f11c00ff3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.395+0000 7f11c82486c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c0115120 0x7f11c00fff90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c57bc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c01146f0 0x7f11c00ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c5fbd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c00fed50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c57bc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c01146f0 0x7f11c00ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:37166/0 (socket says 10.20.193.91:37166) 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c5fbd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c00fed50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51934/0 (socket says 10.20.193.91:51934) 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c82486c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0100720 con 0x7f11c0113dc0 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c82486c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0100890 con 0x7f11c0115120 2026-02-13T01:23:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c82486c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f11c0100a50 con 0x7f11c01146f0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.396+0000 7f11c57bc6c0 1 -- 10.20.193.91:0/2326229791 learned_addr learned my addr 10.20.193.91:0/2326229791 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11c5fbd6c0 1 -- 10.20.193.91:0/2326229791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c01146f0 msgr2=0x7f11c00ff3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11c5fbd6c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c01146f0 0x7f11c00ff3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11c5fbd6c0 1 -- 10.20.193.91:0/2326229791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c0115120 msgr2=0x7f11c00fff90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11c5fbd6c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c0115120 0x7f11c00fff90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11c5fbd6c0 1 -- 10.20.193.91:0/2326229791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b40094c0 con 0x7f11c0113dc0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11c5fbd6c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c00fed50 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b400ba30 tx=0x7f11b400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11b4004250 con 0x7f11c0113dc0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f11b4009030 con 0x7f11c0113dc0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.397+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11b400ce70 con 0x7f11c0113dc0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.398+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b001a9a0 con 0x7f11c0113dc0 2026-02-13T01:23:23.400 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.398+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c017a6d0 con 0x7f11c0113dc0 2026-02-13T01:23:23.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.399+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f11b40028c0 con 0x7f11c0113dc0 2026-02-13T01:23:23.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.400+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c01198e0 con 0x7f11c0113dc0 2026-02-13T01:23:23.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.400+0000 7f11aeffd6c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f119003f870 0x7f119005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.400+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f11b40512a0 con 0x7f11c0113dc0 2026-02-13T01:23:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.400+0000 7f11c57bc6c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f119003f870 0x7f119005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.401+0000 7f11c57bc6c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f119003f870 0x7f119005fd20 secure :-1 s=READY pgs=29 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b00023e0 tx=0x7f11b0002af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/390629752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc10eed0 msgr2=0x7f3bbc10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 --2- 10.20.193.91:0/390629752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc10f2c0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=1311940943705009877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bac009bd0 tx=0x7f3bac02ef90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/390629752 shutdown_connections 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 --2- 10.20.193.91:0/390629752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bbc110a00 0x7f3bbc171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 --2- 10.20.193.91:0/390629752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc110050 0x7f3bbc1104c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 --2- 10.20.193.91:0/390629752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc10f2c0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=1311940943705009877 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/390629752 >> 10.20.193.91:0/390629752 conn(0x7f3bbc0ec5f0 msgr2=0x7f3bbc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/390629752 shutdown_connections 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.402+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/390629752 wait complete. 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bc1d1c6c0 1 Processor -- start 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bc1d1c6c0 1 -- start start 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bc1d1c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc0fcb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bc1d1c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 0x7f3bbc171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bc1d1c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bbc110a00 0x7f3bbc0fd3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bbb7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc0fcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bbb7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc0fcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:37188/0 (socket says 10.20.193.91:37188) 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bbaffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 0x7f3bbc171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.403+0000 7f3bbaffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 0x7f3bbc171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51946/0 (socket says 10.20.193.91:51946) 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bc1d1c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc0fe020 con 0x7f3bbc110050 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bc1d1c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc0fe190 con 0x7f3bbc110a00 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bc1d1c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3bbc0fe350 con 0x7f3bbc10eed0 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 -- 10.20.193.91:0/4001450532 learned_addr learned my addr 10.20.193.91:0/4001450532 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 -- 10.20.193.91:0/4001450532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bbc110a00 msgr2=0x7f3bbc0fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bbc110a00 0x7f3bbc0fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 -- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 msgr2=0x7f3bbc171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 0x7f3bbc171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 -- 10.20.193.91:0/4001450532 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac009590 con 0x7f3bbc10eed0 2026-02-13T01:23:23.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbaffd6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 0x7f3bbc171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:23.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bbb7fe6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc0fcb90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bac009290 tx=0x7f3bac0046d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bac004a60 con 0x7f3bbc10eed0 2026-02-13T01:23:23.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/4001450532 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bbc0fe5d0 con 0x7f3bbc10eed0 2026-02-13T01:23:23.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.405+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3bac02fcb0 con 0x7f3bbc10eed0 2026-02-13T01:23:23.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.405+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bac005720 con 0x7f3bbc10eed0 2026-02-13T01:23:23.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.405+0000 7f3bc1d1c6c0 1 -- 10.20.193.91:0/4001450532 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bbc0fea00 con 0x7f3bbc10eed0 2026-02-13T01:23:23.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.406+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f3bac02f7f0 con 0x7f3bbc10eed0 2026-02-13T01:23:23.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.406+0000 7f3bb8ff96c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3b8403f7a0 0x7f3b8405fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.404+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f11b4003670 con 0x7f11c0113dc0 2026-02-13T01:23:23.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.406+0000 7f3bbaffd6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3b8403f7a0 0x7f3b8405fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.407+0000 7f3bbaffd6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3b8403f7a0 0x7f3b8405fc50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ba8006fd0 tx=0x7f3ba8009190 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 -- 10.20.193.91:0/4155322478 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010ae10 msgr2=0x7fcb6010b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 --2- 10.20.193.91:0/4155322478 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010ae10 0x7fcb6010b200 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=6883014983404822126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c0075a0 tx=0x7fcb4c02fea0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 -- 10.20.193.91:0/4155322478 shutdown_connections 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 --2- 10.20.193.91:0/4155322478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 0x7fcb6016d2d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 --2- 10.20.193.91:0/4155322478 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010bf90 0x7fcb6010c400 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 --2- 10.20.193.91:0/4155322478 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010ae10 0x7fcb6010b200 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=6883014983404822126 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 -- 10.20.193.91:0/4155322478 >> 10.20.193.91:0/4155322478 conn(0x7fcb600e8510 msgr2=0x7fcb60108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 -- 10.20.193.91:0/4155322478 shutdown_connections 2026-02-13T01:23:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.407+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3bac02fe20 con 0x7f3bbc10eed0 2026-02-13T01:23:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.407+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c005310 con 0x7f3bbc10eed0 2026-02-13T01:23:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.410+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/4047833730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10e780 msgr2=0x7f8f3c16f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.410+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/4047833730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10e780 0x7f8f3c16f110 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=9162586323558863928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f3800aa40 tx=0x7f8f3802fe00 comp rx=0 tx=0).stop 2026-02-13T01:23:23.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.408+0000 7fcb689446c0 1 -- 10.20.193.91:0/4155322478 wait complete. 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 Processor -- start 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 -- start start 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 0x7fcb600fe210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010bf90 0x7fcb600fe860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 0x7fcb600fcd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600fd4b0 con 0x7fcb6010ae10 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600fd620 con 0x7fcb6010c940 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb689446c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600fd7e0 con 0x7fcb6010bf90 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb666b96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 0x7fcb600fe210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb666b96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 0x7fcb600fe210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51962/0 (socket says 10.20.193.91:51962) 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb666b96c0 1 -- 10.20.193.91:0/1554281487 learned_addr learned my addr 10.20.193.91:0/1554281487 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.409+0000 7fcb66eba6c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 0x7fcb600fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.410+0000 7fcb66eba6c0 1 -- 10.20.193.91:0/1554281487 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010bf90 msgr2=0x7fcb600fe860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.410+0000 7fcb66eba6c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010bf90 0x7fcb600fe860 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.410+0000 7fcb66eba6c0 1 -- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 msgr2=0x7fcb600fe210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb66eba6c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 0x7fcb600fe210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb66eba6c0 1 -- 10.20.193.91:0/1554281487 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c0071c0 con 0x7fcb6010c940 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb666b96c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 0x7fcb600fe210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb66eba6c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 0x7fcb600fcd20 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb5400c490 tx=0x7fcb5400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb54003c90 con 0x7fcb6010c940 2026-02-13T01:23:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcb54003df0 con 0x7fcb6010c940 2026-02-13T01:23:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.411+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcb5400dca0 con 0x7fcb6010c940 2026-02-13T01:23:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.413+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb601670e0 con 0x7fcb6010c940 2026-02-13T01:23:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.413+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb60167510 con 0x7fcb6010c940 2026-02-13T01:23:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.413+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb60170f20 con 0x7fcb6010c940 2026-02-13T01:23:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.412+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3bac031e00 con 0x7f3bbc10eed0 2026-02-13T01:23:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.414+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff134005b40 con 0x7ff16c113f70 2026-02-13T01:23:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.414+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fcb54005030 con 0x7fcb6010c940 2026-02-13T01:23:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.415+0000 7fcb4b7fe6c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fcb3c03f820 0x7fcb3c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.415+0000 7fcb666b96c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fcb3c03f820 0x7fcb3c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.415+0000 7fcb666b96c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fcb3c03f820 0x7fcb3c05fcd0 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c002950 tx=0x7fcb4c005ae0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.415+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fcb54051f00 con 0x7fcb6010c940 2026-02-13T01:23:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.416+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcb54007e40 con 0x7fcb6010c940 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/4047833730 shutdown_connections 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/4047833730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10e780 0x7f8f3c16f110 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=9162586323558863928 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/4047833730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10ddd0 0x7f8f3c10e240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/4047833730 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f3c10cc50 0x7f8f3c10d040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/4047833730 >> 10.20.193.91:0/4047833730 conn(0x7f8f3c0ea370 msgr2=0x7f8f3c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/4047833730 shutdown_connections 2026-02-13T01:23:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/4047833730 wait complete. 2026-02-13T01:23:23.418 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 Processor -- start 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- start start 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10cc50 0x7f8f3c10f9e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f3c10ddd0 0x7f8f3c110030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 0x7f8f3c110c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c1113b0 con 0x7f8f3c10e780 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c111520 con 0x7f8f3c10cc50 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.418+0000 7f8f42e7b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3c1116e0 con 0x7f8f3c10ddd0 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 0x7f8f3c110c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 0x7f8f3c110c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:51974/0 (socket says 10.20.193.91:51974) 2026-02-13T01:23:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 -- 10.20.193.91:0/3610584173 learned_addr learned my addr 10.20.193.91:0/3610584173 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7ff15affd6c0 1 -- 10.20.193.91:0/1670426558 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v23)=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7ff16000e040 con 0x7ff16c113f70 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 -- 10.20.193.91:0/3610584173 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f3c10ddd0 msgr2=0x7f8f3c110030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f3c10ddd0 0x7f8f3c110030 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 -- 10.20.193.91:0/3610584173 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10cc50 msgr2=0x7f8f3c10f9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10cc50 0x7f8f3c10f9e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.419+0000 7f8f413ed6c0 1 -- 10.20.193.91:0/3610584173 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c0094c0 con 0x7f8f3c10e780 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.421+0000 7f8f413ed6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 0x7f8f3c110c20 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f38030af0 tx=0x7f8f38003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.422+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f38030e70 con 0x7f8f3c10e780 2026-02-13T01:23:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.422+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3800a660 con 0x7f8f3c10e780 2026-02-13T01:23:23.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.422+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f3c151cb0 con 0x7f8f3c10e780 2026-02-13T01:23:23.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.422+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8f38032030 con 0x7f8f3c10e780 2026-02-13T01:23:23.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.422+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f38008440 con 0x7f8f3c10e780 2026-02-13T01:23:23.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.423+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f04005310 con 0x7f8f3c10e780 2026-02-13T01:23:23.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.423+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f8f380085a0 con 0x7f8f3c10e780 2026-02-13T01:23:23.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.423+0000 7f8f31ffb6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f0c03f870 0x7f8f0c05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.424+0000 7f8f40bec6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f0c03f870 0x7f8f0c05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.424+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8f380765a0 con 0x7f8f3c10e780 2026-02-13T01:23:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.424+0000 7f8f40bec6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f0c03f870 0x7f8f0c05fd20 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f24004750 tx=0x7f8f240093b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.429+0000 7fc10839b6c0 1 -- 10.20.193.91:0/1742399380 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 msgr2=0x7fc10016f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.429+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/1742399380 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc10016f110 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=4741637719790311532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0fc00aa40 tx=0x7fc0fc02fdf0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.428+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8f38008880 con 0x7f8f3c10e780 2026-02-13T01:23:23.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff14803f820 msgr2=0x7ff14805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7ff158ff96c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff14803f820 0x7ff14805fcd0 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff164009610 tx=0x7ff164038fd0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 msgr2=0x7ff16c175970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7ff158ff96c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 0x7ff16c175970 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff16000c7f0 tx=0x7ff16000ccc0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/1337679015 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810cc50 msgr2=0x7fd2e810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/1337679015 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810cc50 0x7fd2e810d040 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=6350990294102897853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2dc009b00 tx=0x7fd2dc02eed0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/1337679015 shutdown_connections 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/1337679015 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810e780 0x7fd2e816f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/1337679015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2e810ddd0 0x7fd2e810e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/1337679015 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810cc50 0x7fd2e810d040 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=6350990294102897853 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/1337679015 >> 10.20.193.91:0/1337679015 conn(0x7fd2e80ea370 msgr2=0x7fd2e810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/1337679015 shutdown_connections 2026-02-13T01:23:23.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/1337679015 wait complete. 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.431+0000 7fd2ed9046c0 1 Processor -- start 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.431+0000 7fd2ed9046c0 1 -- start start 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.432+0000 7fd2ed9046c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2e810cc50 0x7fd2e80f6330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.432+0000 7fd2ed9046c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810ddd0 0x7fd2e816f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.432+0000 7fd2ed9046c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 0x7fd2e80f6b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fc10839b6c0 1 -- 10.20.193.91:0/1742399380 shutdown_connections 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/1742399380 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc10016f110 unknown :-1 s=CLOSED pgs=121 gs=2 cs=0 l=1 c_cookie=4741637719790311532 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/1742399380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc10010ddd0 0x7fc10010e240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/1742399380 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 0x7fc10010d040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.430+0000 7fc10839b6c0 1 -- 10.20.193.91:0/1742399380 >> 10.20.193.91:0/1742399380 conn(0x7fc1000ea370 msgr2=0x7fc10010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fc10839b6c0 1 -- 10.20.193.91:0/1742399380 shutdown_connections 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fc10839b6c0 1 -- 10.20.193.91:0/1742399380 wait complete. 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.434+0000 7fc10839b6c0 1 Processor -- start 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.434+0000 7fc10839b6c0 1 -- start start 2026-02-13T01:23:23.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.434+0000 7fc10839b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 0x7fc1000f6120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10839b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc10010ddd0 0x7fc10016f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10839b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc1000f6980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10610c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 0x7fc1000f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10610c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 0x7fc1000f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:37256/0 (socket says 10.20.193.91:37256) 2026-02-13T01:23:23.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10690d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc1000f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10690d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc1000f6980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:52016/0 (socket says 10.20.193.91:52016) 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10610c6c0 1 -- 10.20.193.91:0/3496294254 learned_addr learned my addr 10.20.193.91:0/3496294254 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc1000f75b0 con 0x7fc10010e780 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc1000f7720 con 0x7fc10010ddd0 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1000f78e0 con 0x7fc10010cc50 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10690d6c0 1 -- 10.20.193.91:0/3496294254 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 msgr2=0x7fc1000f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10690d6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 0x7fc1000f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10690d6c0 1 -- 10.20.193.91:0/3496294254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc10010ddd0 msgr2=0x7fc10016f110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10690d6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc10010ddd0 0x7fc10016f110 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10690d6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc00a660 con 0x7fc10010e780 2026-02-13T01:23:23.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10690d6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc1000f6980 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0fc006a80 tx=0x7fc0fc00a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0fc003da0 con 0x7fc10010e780 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.436+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1000f7b60 con 0x7fc10010e780 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 shutdown_connections 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7ff158ff96c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff14803f820 0x7ff14805fcd0 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7ff158ff96c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff16c1554e0 0x7ff16c113450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7ff158ff96c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff16c134920 0x7ff16c154d40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7ff158ff96c0 1 --2- 10.20.193.91:0/1670426558 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff16c113f70 0x7ff16c175970 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 >> 10.20.193.91:0/1670426558 conn(0x7ff16c05b8e0 msgr2=0x7ff16c1077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 shutdown_connections 2026-02-13T01:23:23.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7ff158ff96c0 1 -- 10.20.193.91:0/1670426558 wait complete. 2026-02-13T01:23:23.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.438+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1000f7f20 con 0x7fc10010e780 2026-02-13T01:23:23.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.438+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc0fc039550 con 0x7fc10010e780 2026-02-13T01:23:23.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.439+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc0fc0323b0 con 0x7fc10010e780 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2e77fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 0x7fd2e80f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2e77fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 0x7fd2e80f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:52004/0 (socket says 10.20.193.91:52004) 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2e77fe6c0 1 -- 10.20.193.91:0/3985286667 learned_addr learned my addr 10.20.193.91:0/3985286667 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80f77c0 con 0x7fd2e810e780 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80f7930 con 0x7fd2e810cc50 2026-02-13T01:23:23.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80f7af0 con 0x7fd2e810ddd0 2026-02-13T01:23:23.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2e6ffd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2e810cc50 0x7fd2e80f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.439+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc100172fd0 con 0x7fc10010e780 2026-02-13T01:23:23.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.439+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fc0fc032550 con 0x7fc10010e780 2026-02-13T01:23:23.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.440+0000 7fc0e77fe6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc0d003f7f0 0x7fc0d005fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.440+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc0fc080550 con 0x7fc10010e780 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.440+0000 7fc10610c6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc0d003f7f0 0x7fc0d005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.433+0000 7fd2e67fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810ddd0 0x7fd2e816f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fd2e67fc6c0 1 -- 10.20.193.91:0/3985286667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2e810cc50 msgr2=0x7fd2e80f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fd2e67fc6c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2e810cc50 0x7fd2e80f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.435+0000 7fd2e67fc6c0 1 -- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 msgr2=0x7fd2e80f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.440+0000 7fd2e67fc6c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 0x7fd2e80f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.440+0000 7fc10610c6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc0d003f7f0 0x7fc0d005fca0 secure :-1 s=READY pgs=33 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0f0009260 tx=0x7fc0f0009440 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.441+0000 7fd2e67fc6c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2dc0094c0 con 0x7fd2e810ddd0 2026-02-13T01:23:23.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.441+0000 7fd2e77fe6c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 0x7fd2e80f6b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:23:23.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.442+0000 7fd2e67fc6c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810ddd0 0x7fd2e816f110 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2d000b6e0 tx=0x7fd2d000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.443+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2d001dc50 con 0x7fd2e810ddd0 2026-02-13T01:23:23.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.444+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd2d0009030 con 0x7fd2e810ddd0 2026-02-13T01:23:23.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.444+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2d0007220 con 0x7fd2e810ddd0 2026-02-13T01:23:23.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.444+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e80f7dd0 con 0x7fd2e810ddd0 2026-02-13T01:23:23.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.444+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e80f8260 con 0x7fd2e810ddd0 2026-02-13T01:23:23.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.444+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc0fc032830 con 0x7fc10010e780 2026-02-13T01:23:23.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.445+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fd2d00073d0 con 0x7fd2e810ddd0 2026-02-13T01:23:23.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.445+0000 7fd2ec9026c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd2c003f870 0x7fd2c005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.445+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e8173070 con 0x7fd2e810ddd0 2026-02-13T01:23:23.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.445+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fd2d0063500 con 0x7fd2e810ddd0 2026-02-13T01:23:23.446 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.447+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2d001f4f0 con 0x7fd2e810ddd0 2026-02-13T01:23:23.446 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.448+0000 7fd2e6ffd6c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd2c003f870 0x7fd2c005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.448+0000 7fd2e6ffd6c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd2c003f870 0x7fd2c005fd20 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2dc009a50 tx=0x7fd2dc0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 -- 10.20.193.91:0/210913866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306810eed0 msgr2=0x7f306810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/210913866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306810eed0 0x7f306810f2c0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=8033313099847507708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3054009970 tx=0x7f305402ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:23.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 -- 10.20.193.91:0/210913866 shutdown_connections 2026-02-13T01:23:23.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/210913866 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3068110a00 0x7f3068171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/210913866 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f30681104c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/210913866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306810eed0 0x7f306810f2c0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=8033313099847507708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 -- 10.20.193.91:0/210913866 >> 10.20.193.91:0/210913866 conn(0x7f30680ec5f0 msgr2=0x7f306810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 -- 10.20.193.91:0/210913866 shutdown_connections 2026-02-13T01:23:23.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.449+0000 7f306e9e06c0 1 -- 10.20.193.91:0/210913866 wait complete. 2026-02-13T01:23:23.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 Processor -- start 2026-02-13T01:23:23.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 -- start start 2026-02-13T01:23:23.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f306810eed0 0x7f3068057c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f3068171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f3067fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f306810eed0 0x7f3068057c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f30677fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f3068171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f30677fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f3068171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:52030/0 (socket says 10.20.193.91:52030) 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f30677fe6c0 1 -- 10.20.193.91:0/350296287 learned_addr learned my addr 10.20.193.91:0/350296287 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3068110a00 0x7f3068058bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f30680586c0 con 0x7f3068110050 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.450+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3068058830 con 0x7f3068110a00 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3068059150 con 0x7f306810eed0 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30677fe6c0 1 -- 10.20.193.91:0/350296287 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f306810eed0 msgr2=0x7f3068057c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30677fe6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f306810eed0 0x7f3068057c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30677fe6c0 1 -- 10.20.193.91:0/350296287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3068110a00 msgr2=0x7f3068058bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30677fe6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3068110a00 0x7f3068058bc0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30677fe6c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3054009590 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30677fe6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f3068171390 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3058009490 tx=0x7f305800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f3067fff6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f306810eed0 0x7f3068057c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3058004a80 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.451+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3058009030 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.452+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f305800cd70 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.452+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3068059430 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.452+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30680598e0 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.453+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f3058004be0 con 0x7f3068110050 2026-02-13T01:23:23.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.453+0000 7f30657fa6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f303c03f7a0 0x7f303c05fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.453+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f3058051220 con 0x7f3068110050 2026-02-13T01:23:23.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.453+0000 7f3067fff6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f303c03f7a0 0x7f303c05fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.454+0000 7f3067fff6c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f303c03f7a0 0x7f303c05fc50 secure :-1 s=READY pgs=35 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f305402f230 tx=0x7f3054005ae0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.457+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30681752f0 con 0x7f3068110050 2026-02-13T01:23:23.459 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.462+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3058008260 con 0x7f3068110050 2026-02-13T01:23:23.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.462+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f516010f0f0 con 0x7f5160110830 2026-02-13T01:23:23.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.466+0000 7f514f7fe6c0 1 -- 10.20.193.91:0/2142803646 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f515c0338d0 con 0x7f5160110830 2026-02-13T01:23:23.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/1432137392 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 msgr2=0x7f63ac16f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/1432137392 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac16f110 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=17609685033436873586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639c00aa40 tx=0x7f639c02fe30 comp rx=0 tx=0).stop 2026-02-13T01:23:23.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/1432137392 shutdown_connections 2026-02-13T01:23:23.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/1432137392 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac16f110 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=17609685033436873586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/1432137392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 0x7f63ac10e240 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/1432137392 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63ac10cc50 0x7f63ac10d040 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/1432137392 >> 10.20.193.91:0/1432137392 conn(0x7f63ac0ea370 msgr2=0x7f63ac10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/1432137392 shutdown_connections 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.467+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/1432137392 wait complete. 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 Processor -- start 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 -- start start 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63ac10cc50 0x7f63ac061ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 0x7f63ac062330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac0607f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac060f80 con 0x7f63ac10e780 2026-02-13T01:23:23.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac0610f0 con 0x7f63ac10ddd0 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63b0bfd6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac0612b0 con 0x7f63ac10cc50 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63a9d746c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 0x7f63ac062330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.468+0000 7f63a9d746c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 0x7f63ac062330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:50756/0 (socket says 10.20.193.91:50756) 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63a9d746c0 1 -- 10.20.193.91:0/2524656442 learned_addr learned my addr 10.20.193.91:0/2524656442 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac0607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 -- 10.20.193.91:0/2524656442 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63ac10cc50 msgr2=0x7f63ac061ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63ac10cc50 0x7f63ac061ce0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 -- 10.20.193.91:0/2524656442 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 msgr2=0x7f63ac062330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 0x7f63ac062330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 -- 10.20.193.91:0/2524656442 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639c00a660 con 0x7f63ac10e780 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63aad766c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac0607f0 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639c032fd0 tx=0x7f639c005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f639c003a30 con 0x7f63ac10e780 2026-02-13T01:23:23.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f639c030e10 con 0x7f63ac10e780 2026-02-13T01:23:23.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac168f20 con 0x7f63ac10e780 2026-02-13T01:23:23.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.469+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac169420 con 0x7f63ac10e780 2026-02-13T01:23:23.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.470+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f639c0085b0 con 0x7f63ac10e780 2026-02-13T01:23:23.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f639c0326a0 con 0x7f63ac10e780 2026-02-13T01:23:23.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f639b7fe6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f638403f820 0x7f638405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f639c076690 con 0x7f63ac10e780 2026-02-13T01:23:23.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f63aa5756c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f638403f820 0x7f638405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.472+0000 7f63aa5756c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f638403f820 0x7f638405fcd0 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6394004770 tx=0x7f6394006c90 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.472+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6370005310 con 0x7f63ac10e780 2026-02-13T01:23:23.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f513803f820 msgr2=0x7f513805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f513803f820 0x7f513805fcd0 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5154005b40 tx=0x7f5154009310 comp rx=0 tx=0).stop 2026-02-13T01:23:23.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5160110830 msgr2=0x7f51600f8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.471+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5160110830 0x7f51600f8c20 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f515c030a90 tx=0x7f515c0307b0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.472+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f3c180fa8b0 con 0x7f3c18110a00 2026-02-13T01:23:23.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.475+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f639c008ad0 con 0x7f63ac10e780 2026-02-13T01:23:23.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f45740ef1b0 con 0x7f457410cc50 2026-02-13T01:23:23.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.478+0000 7f3c067fc6c0 1 -- 10.20.193.91:0/4257576921 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f3c1400f030 con 0x7f3c18110a00 2026-02-13T01:23:23.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 shutdown_connections 2026-02-13T01:23:23.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f513803f820 0x7f513805fcd0 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5160110830 0x7f51600f8c20 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f516010fe80 0x7f51601711c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f51670e76c0 1 --2- 10.20.193.91:0/2142803646 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f516010ed00 0x7f51600f83c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 >> 10.20.193.91:0/2142803646 conn(0x7f51600ec400 msgr2=0x7f51600ee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.478+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 shutdown_connections 2026-02-13T01:23:23.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.478+0000 7f51670e76c0 1 -- 10.20.193.91:0/2142803646 wait complete. 2026-02-13T01:23:23.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.477+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}] v 0) -- 0x7efce4172910 con 0x7efce410ddb0 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.481+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3bf403f820 msgr2=0x7f3bf405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.481+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3bf403f820 0x7f3bf405fcd0 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c08006f40 tx=0x7f3c08009210 comp rx=0 tx=0).stop 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.481+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110a00 msgr2=0x7f3c180f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.481+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110a00 0x7f3c180f8e80 secure :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c1400c4b0 tx=0x7f3c1400c980 comp rx=0 tx=0).stop 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 shutdown_connections 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3bf403f820 0x7f3bf405fcd0 unknown :-1 s=CLOSED pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c18110a00 0x7f3c180f8e80 unknown :-1 s=CLOSED pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c18110050 0x7f3c18171390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 --2- 10.20.193.91:0/4257576921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c1810eed0 0x7f3c180f8620 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 >> 10.20.193.91:0/4257576921 conn(0x7f3c180ec5f0 msgr2=0x7f3c180eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 shutdown_connections 2026-02-13T01:23:23.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.482+0000 7f3c1f6906c0 1 -- 10.20.193.91:0/4257576921 wait complete. 2026-02-13T01:23:23.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.483+0000 7efccb7fe6c0 1 -- 10.20.193.91:0/665987765 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}]=0 v26)=0 v26) ==== 141+0+0 (secure 0 0 0) 0x7efcd403a030 con 0x7efce410ddb0 2026-02-13T01:23:23.489 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.487+0000 7f4553fff6c0 1 -- 10.20.193.91:0/4055239491 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f456800f870 con 0x7f457410cc50 2026-02-13T01:23:23.489 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.487+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efcc003f870 msgr2=0x7efcc005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.487+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efcc003f870 0x7efcc005fd20 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd8005980 tx=0x7efcd8005d20 comp rx=0 tx=0).stop 2026-02-13T01:23:23.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.487+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 msgr2=0x7efce4062330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.487+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 0x7efce4062330 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efcd40023e0 tx=0x7efcd4002cd0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f326c1749e0 con 0x7f326c10eed0 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/2755862838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1810eed0 msgr2=0x7f1b1810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 --2- 10.20.193.91:0/2755862838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1810eed0 0x7f1b1810f2c0 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=569492872742874434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0c009970 tx=0x7f1b0c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/2755862838 shutdown_connections 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 --2- 10.20.193.91:0/2755862838 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b18110a00 0x7f1b18171390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 --2- 10.20.193.91:0/2755862838 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b18110050 0x7f1b181104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 --2- 10.20.193.91:0/2755862838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1810eed0 0x7f1b1810f2c0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=569492872742874434 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/2755862838 >> 10.20.193.91:0/2755862838 conn(0x7f1b180ec5f0 msgr2=0x7f1b1810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/2755862838 shutdown_connections 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.486+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/2755862838 wait complete. 2026-02-13T01:23:23.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 Processor -- start 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 -- start start 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 0x7f1b180f8580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b18110050 0x7f1b18171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b18110a00 0x7f1b180f8de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180f9a10 con 0x7f1b1810eed0 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180f9b80 con 0x7f1b18110a00 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b1d0d06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180f9d40 con 0x7f1b18110050 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b16d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 0x7f1b180f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b16d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 0x7f1b180f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:52062/0 (socket says 10.20.193.91:52062) 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b16d766c0 1 -- 10.20.193.91:0/640441538 learned_addr learned my addr 10.20.193.91:0/640441538 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b175776c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b18110a00 0x7f1b180f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.488+0000 7f1b165756c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b18110050 0x7f1b18171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b16d766c0 1 -- 10.20.193.91:0/640441538 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b18110050 msgr2=0x7f1b18171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b16d766c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b18110050 0x7f1b18171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b16d766c0 1 -- 10.20.193.91:0/640441538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b18110a00 msgr2=0x7f1b180f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b16d766c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b18110a00 0x7f1b180f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b16d766c0 1 -- 10.20.193.91:0/640441538 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c009590 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b175776c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b18110a00 0x7f1b180f8de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b16d766c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 0x7f1b180f8580 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0c0092b0 tx=0x7f1b0c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b0c002ba0 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/640441538 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b180f9fc0 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1b0c002d00 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b0c0362f0 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.489+0000 7f1b1d0d06c0 1 -- 10.20.193.91:0/640441538 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b180fa490 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.490+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae0005310 con 0x7f1b1810eed0 2026-02-13T01:23:23.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.491+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f1b0c007980 con 0x7f1b1810eed0 2026-02-13T01:23:23.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.491+0000 7f1af7fff6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1aec03f820 0x7f1aec05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.491+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1b0c075410 con 0x7f1b1810eed0 2026-02-13T01:23:23.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.491+0000 7f1b165756c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1aec03f820 0x7f1aec05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.491+0000 7f1b165756c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1aec03f820 0x7f1aec05fcd0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b00004750 tx=0x7f1b00009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 shutdown_connections 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efcc003f870 0x7efcc005fd20 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efce410e760 0x7efce40607f0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efce410ddb0 0x7efce4062330 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 --2- 10.20.193.91:0/665987765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce410cc30 0x7efce4061ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 >> 10.20.193.91:0/665987765 conn(0x7efce40ea330 msgr2=0x7efce40564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 shutdown_connections 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7efcec7086c0 1 -- 10.20.193.91:0/665987765 wait complete. 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f454c03f820 msgr2=0x7f454c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7f45795446c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f454c03f820 0x7f454c05fcd0 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f455c004750 tx=0x7f455c009260 comp rx=0 tx=0).stop 2026-02-13T01:23:23.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 msgr2=0x7f45740f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.494+0000 7f45795446c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f45740f6300 secure :-1 s=READY pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f456800b6c0 tx=0x7f456800bb90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.493+0000 7f32537fe6c0 1 -- 10.20.193.91:0/730516534 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f3260008030 con 0x7f326c10eed0 2026-02-13T01:23:23.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1b0c030880 con 0x7f1b1810eed0 2026-02-13T01:23:23.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f324403f7f0 msgr2=0x7f324405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f324403f7f0 0x7f324405fca0 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3254005980 tx=0x7f3254005910 comp rx=0 tx=0).stop 2026-02-13T01:23:23.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 msgr2=0x7f326c0f8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c0f8500 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3260009490 tx=0x7f326000bca0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 shutdown_connections 2026-02-13T01:23:23.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f324403f7f0 0x7f324405fca0 unknown :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f326c110a00 0x7f326c0f8d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f326c110050 0x7f326c171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 --2- 10.20.193.91:0/730516534 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f326c10eed0 0x7f326c0f8500 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 >> 10.20.193.91:0/730516534 conn(0x7f326c0ec5f0 msgr2=0x7f326c0ee580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 shutdown_connections 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f454c03f820 0x7f454c05fcd0 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f457410e780 0x7f45740f6b60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f457410ddd0 0x7f457416f110 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 --2- 10.20.193.91:0/4055239491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f457410cc50 0x7f45740f6300 unknown :-1 s=CLOSED pgs=9 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 >> 10.20.193.91:0/4055239491 conn(0x7f45740ea370 msgr2=0x7f45740ec910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 shutdown_connections 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f45795446c0 1 -- 10.20.193.91:0/4055239491 wait complete. 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.498+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 shutdown_connections 2026-02-13T01:23:23.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.499+0000 7f3270f0c6c0 1 -- 10.20.193.91:0/730516534 wait complete. 2026-02-13T01:23:23.523 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.523 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.524 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_use_global_snaprealm_seq_for_subvol', 'False'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.526+0000 7f03d5be36c0 1 -- 10.20.193.91:0/1294192910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 msgr2=0x7f03d0065160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.526+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/1294192910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d0065160 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=5422034847499442131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03c400aa40 tx=0x7f03c402fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 -- 10.20.193.91:0/1294192910 shutdown_connections 2026-02-13T01:23:23.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/1294192910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d0065160 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=5422034847499442131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/1294192910 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d0063e50 0x7f03d00642c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/1294192910 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 0x7f03d00630c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 -- 10.20.193.91:0/1294192910 >> 10.20.193.91:0/1294192910 conn(0x7f03d00ec5f0 msgr2=0x7f03d010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 -- 10.20.193.91:0/1294192910 shutdown_connections 2026-02-13T01:23:23.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.527+0000 7f03d5be36c0 1 -- 10.20.193.91:0/1294192910 wait complete. 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.528+0000 7f03d5be36c0 1 Processor -- start 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.528+0000 7f03d5be36c0 1 -- start start 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.528+0000 7f03d5be36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 0x7f03d01092c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.528+0000 7f03d5be36c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d0063e50 0x7f03d0109910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.528+0000 7f03d5be36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d010a500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03d5be36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f03d010ac90 con 0x7f03d0064800 2026-02-13T01:23:23.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03d5be36c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f03d010ae00 con 0x7f03d0063e50 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03ceffd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d0063e50 0x7f03d0109910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03d5be36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03d010afc0 con 0x7f03d0062cd0 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d010a500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d010a500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:52072/0 (socket says 10.20.193.91:52072) 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 -- 10.20.193.91:0/926465462 learned_addr learned my addr 10.20.193.91:0/926465462 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cf7fe6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 0x7f03d01092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 -- 10.20.193.91:0/926465462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 msgr2=0x7f03d01092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 0x7f03d01092c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 -- 10.20.193.91:0/926465462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d0063e50 msgr2=0x7f03d0109910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d0063e50 0x7f03d0109910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 -- 10.20.193.91:0/926465462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c400a660 con 0x7f03d0064800 2026-02-13T01:23:23.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cf7fe6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 0x7f03d01092c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:23.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.529+0000 7f03cffff6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d010a500 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03c4006c20 tx=0x7f03c4003810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.530+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f03c4003e20 con 0x7f03d0064800 2026-02-13T01:23:23.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.530+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f03c4008720 con 0x7f03d0064800 2026-02-13T01:23:23.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.531+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f03c40386c0 con 0x7f03d0064800 2026-02-13T01:23:23.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.531+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d010b240 con 0x7f03d0064800 2026-02-13T01:23:23.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.531+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d010b720 con 0x7f03d0064800 2026-02-13T01:23:23.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.533+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f03c4008260 con 0x7f03d0064800 2026-02-13T01:23:23.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.533+0000 7f03ccff96c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03a803f7a0 0x7f03a805fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.534+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f03c4076620 con 0x7f03d0064800 2026-02-13T01:23:23.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.534+0000 7f03cf7fe6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03a803f7a0 0x7f03a805fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.534+0000 7f03cf7fe6c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03a803f7a0 0x7f03a805fc50 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03bc004750 tx=0x7f03bc009630 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.534+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d0179840 con 0x7f03d0064800 2026-02-13T01:23:23.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.541+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f03c4038820 con 0x7f03d0064800 2026-02-13T01:23:23.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/2347665384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410cc50 msgr2=0x7f35b410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/2347665384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410cc50 0x7f35b410d040 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=5771488574588123116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35a8009970 tx=0x7f35a802ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:23.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/2347665384 shutdown_connections 2026-02-13T01:23:23.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/2347665384 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410e780 0x7f35b416f110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/2347665384 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f35b410ddd0 0x7f35b410e240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/2347665384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410cc50 0x7f35b410d040 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=5771488574588123116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/2347665384 >> 10.20.193.91:0/2347665384 conn(0x7f35b40ea370 msgr2=0x7f35b410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/2347665384 shutdown_connections 2026-02-13T01:23:23.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.544+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/2347665384 wait complete. 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 Processor -- start 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 -- start start 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410cc50 0x7f35b4061ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 0x7f35b4062330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f35b410e780 0x7f35b40607f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4060f80 con 0x7f35b410cc50 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40610f0 con 0x7f35b410ddd0 2026-02-13T01:23:23.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b8ed56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f35b40612b0 con 0x7f35b410e780 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b1d746c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 0x7f35b4062330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b25756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410cc50 0x7f35b4061ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b1d746c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 0x7f35b4062330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:50814/0 (socket says 10.20.193.91:50814) 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.545+0000 7f35b1d746c0 1 -- 10.20.193.91:0/303696726 learned_addr learned my addr 10.20.193.91:0/303696726 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b2d766c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f35b410e780 0x7f35b40607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b25756c0 1 -- 10.20.193.91:0/303696726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f35b410e780 msgr2=0x7f35b40607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b25756c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f35b410e780 0x7f35b40607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b25756c0 1 -- 10.20.193.91:0/303696726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 msgr2=0x7f35b4062330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b25756c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 0x7f35b4062330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b25756c0 1 -- 10.20.193.91:0/303696726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a400a5b0 con 0x7f35b410cc50 2026-02-13T01:23:23.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b1d746c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 0x7f35b4062330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b25756c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410cc50 0x7f35b4061ce0 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35a802f230 tx=0x7f35a8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35a80028d0 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a8009590 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b40fee20 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f35a802fdf0 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.546+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35a80319a0 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.547+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b4172ff0 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.547+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f35a80071c0 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.547+0000 7f359b7fe6c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f358c03f820 0x7f358c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.548+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f35a8075650 con 0x7f35b410cc50 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.548+0000 7f35b1d746c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f358c03f820 0x7f358c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:23.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.548+0000 7f35b1d746c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f358c03f820 0x7f358c05fcd0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f359c0095c0 tx=0x7f359c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:23.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.551+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f35a8032270 con 0x7f35b410cc50 2026-02-13T01:23:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.560+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fcb600fd9a0 con 0x7fcb6010c940 2026-02-13T01:23:23.561 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.564+0000 7fcb4b7fe6c0 1 -- 10.20.193.91:0/1554281487 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7fcb5400e890 con 0x7fcb6010c940 2026-02-13T01:23:23.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.566+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fcb3c03f820 msgr2=0x7fcb3c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.566+0000 7fcb689446c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fcb3c03f820 0x7fcb3c05fcd0 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c002950 tx=0x7fcb4c005ae0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.566+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 msgr2=0x7fcb600fcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.566+0000 7fcb689446c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 0x7fcb600fcd20 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb5400c490 tx=0x7fcb5400c960 comp rx=0 tx=0).stop 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 shutdown_connections 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fcb3c03f820 0x7fcb3c05fcd0 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb6010c940 0x7fcb600fcd20 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcb6010bf90 0x7fcb600fe860 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 --2- 10.20.193.91:0/1554281487 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcb6010ae10 0x7fcb600fe210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 >> 10.20.193.91:0/1554281487 conn(0x7fcb600e8510 msgr2=0x7fcb600561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 shutdown_connections 2026-02-13T01:23:23.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.567+0000 7fcb689446c0 1 -- 10.20.193.91:0/1554281487 wait complete. 2026-02-13T01:23:23.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.571+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f11c01155c0 con 0x7f11c0113dc0 2026-02-13T01:23:23.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.572+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8f040055c0 con 0x7f8f3c10e780 2026-02-13T01:23:23.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.573+0000 7f11aeffd6c0 1 -- 10.20.193.91:0/2326229791 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v30)=0 v30) ==== 115+0+0 (secure 0 0 0) 0x7f11b400ee60 con 0x7f11c0113dc0 2026-02-13T01:23:23.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f119003f870 msgr2=0x7f119005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f119003f870 0x7f119005fd20 secure :-1 s=READY pgs=29 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b00023e0 tx=0x7f11b0002af0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 msgr2=0x7f11c00fed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c00fed50 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11b400ba30 tx=0x7f11b400bf00 comp rx=0 tx=0).stop 2026-02-13T01:23:23.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f8f31ffb6c0 1 -- 10.20.193.91:0/3610584173 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v31)=0 v31) ==== 111+0+0 (secure 0 0 0) 0x7f8f38036040 con 0x7f8f3c10e780 2026-02-13T01:23:23.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 shutdown_connections 2026-02-13T01:23:23.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f119003f870 0x7f119005fd20 unknown :-1 s=CLOSED pgs=29 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11c0115120 0x7f11c00fff90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f11c01146f0 0x7f11c00ff3a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 --2- 10.20.193.91:0/2326229791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f11c0113dc0 0x7f11c00fed50 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 >> 10.20.193.91:0/2326229791 conn(0x7f11c005b8e0 msgr2=0x7f11c00f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 shutdown_connections 2026-02-13T01:23:23.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.576+0000 7f11c82486c0 1 -- 10.20.193.91:0/2326229791 wait complete. 2026-02-13T01:23:23.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.577+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fd2e8172710 con 0x7fd2e810ddd0 2026-02-13T01:23:23.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.578+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f3b7c005b40 con 0x7f3bbc10eed0 2026-02-13T01:23:23.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.578+0000 7fd2ec9026c0 1 -- 10.20.193.91:0/3985286667 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v31)=0 v31) ==== 106+0+0 (secure 0 0 0) 0x7fd2d0005000 con 0x7fd2e810ddd0 2026-02-13T01:23:23.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.578+0000 7f3bb8ff96c0 1 -- 10.20.193.91:0/4001450532 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v31)=0 v31) ==== 108+0+0 (secure 0 0 0) 0x7f3bac031e00 con 0x7f3bbc10eed0 2026-02-13T01:23:23.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f0c03f870 msgr2=0x7f8f0c05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f0c03f870 0x7f8f0c05fd20 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f24004750 tx=0x7f8f240093b0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 msgr2=0x7f8f3c110c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 0x7f8f3c110c20 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f38030af0 tx=0x7f8f38003a40 comp rx=0 tx=0).stop 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 shutdown_connections 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f0c03f870 0x7f8f0c05fd20 unknown :-1 s=CLOSED pgs=32 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f3c10e780 0x7f8f3c110c20 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f3c10ddd0 0x7f8f3c110030 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 --2- 10.20.193.91:0/3610584173 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f3c10cc50 0x7f8f3c10f9e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.580+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 >> 10.20.193.91:0/3610584173 conn(0x7f8f3c0ea370 msgr2=0x7f8f3c10a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd2c003f870 msgr2=0x7fd2c005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd2c003f870 0x7fd2c005fd20 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2dc009a50 tx=0x7fd2dc0023a0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810ddd0 msgr2=0x7fd2e816f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810ddd0 0x7fd2e816f110 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2d000b6e0 tx=0x7fd2d000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 shutdown_connections 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd2c003f870 0x7fd2c005fd20 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd2e810e780 0x7fd2e80f6b90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd2e810ddd0 0x7fd2e816f110 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 --2- 10.20.193.91:0/3985286667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2e810cc50 0x7fd2e80f6330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 >> 10.20.193.91:0/3985286667 conn(0x7fd2e80ea370 msgr2=0x7fd2e80ec910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 shutdown_connections 2026-02-13T01:23:23.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.581+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 shutdown_connections 2026-02-13T01:23:23.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.582+0000 7f8f42e7b6c0 1 -- 10.20.193.91:0/3610584173 wait complete. 2026-02-13T01:23:23.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7fd2ed9046c0 1 -- 10.20.193.91:0/3985286667 wait complete. 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3b8403f7a0 msgr2=0x7f3b8405fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3b8403f7a0 0x7f3b8405fc50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ba8006fd0 tx=0x7f3ba8009190 comp rx=0 tx=0).stop 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 msgr2=0x7f3bbc0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc0fcb90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bac009290 tx=0x7f3bac0046d0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 shutdown_connections 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3b8403f7a0 0x7f3b8405fc50 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bbc110a00 0x7f3bbc0fd3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3bbc110050 0x7f3bbc171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 --2- 10.20.193.91:0/4001450532 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3bbc10eed0 0x7f3bbc0fcb90 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 >> 10.20.193.91:0/4001450532 conn(0x7f3bbc0ec5f0 msgr2=0x7f3bbc062870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 shutdown_connections 2026-02-13T01:23:23.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.583+0000 7f3b9e7fc6c0 1 -- 10.20.193.91:0/4001450532 wait complete. 2026-02-13T01:23:23.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.588+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f3068174ad0 con 0x7f3068110050 2026-02-13T01:23:23.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.591+0000 7f30657fa6c0 1 -- 10.20.193.91:0/350296287 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7f30580038c0 con 0x7f3068110050 2026-02-13T01:23:23.591 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f303c03f7a0 msgr2=0x7f303c05fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f303c03f7a0 0x7f303c05fc50 secure :-1 s=READY pgs=35 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f305402f230 tx=0x7f3054005ae0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 msgr2=0x7f3068171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f3068171390 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3058009490 tx=0x7f305800bca0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 shutdown_connections 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f303c03f7a0 0x7f303c05fc50 unknown :-1 s=CLOSED pgs=35 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3068110a00 0x7f3068058bc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3068110050 0x7f3068171390 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 --2- 10.20.193.91:0/350296287 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f306810eed0 0x7f3068057c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 >> 10.20.193.91:0/350296287 conn(0x7f30680ec5f0 msgr2=0x7f3068063bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 shutdown_connections 2026-02-13T01:23:23.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.595+0000 7f306e9e06c0 1 -- 10.20.193.91:0/350296287 wait complete. 2026-02-13T01:23:23.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.598+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fc1000eeb60 con 0x7fc10010e780 2026-02-13T01:23:23.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.602+0000 7fc0e77fe6c0 1 -- 10.20.193.91:0/3496294254 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) ==== 138+0+0 (secure 0 0 0) 0x7fc0fc03a550 con 0x7fc10010e780 2026-02-13T01:23:23.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc0d003f7f0 msgr2=0x7fc0d005fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc0d003f7f0 0x7fc0d005fca0 secure :-1 s=READY pgs=33 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0f0009260 tx=0x7fc0f0009440 comp rx=0 tx=0).stop 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 msgr2=0x7fc1000f6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc1000f6980 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0fc006a80 tx=0x7fc0fc00a1a0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 shutdown_connections 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc0d003f7f0 0x7fc0d005fca0 unknown :-1 s=CLOSED pgs=33 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc10010e780 0x7fc1000f6980 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc10010ddd0 0x7fc10016f110 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 --2- 10.20.193.91:0/3496294254 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc10010cc50 0x7fc1000f6120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 >> 10.20.193.91:0/3496294254 conn(0x7fc1000ea370 msgr2=0x7fc1000ec1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 shutdown_connections 2026-02-13T01:23:23.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.607+0000 7fc10839b6c0 1 -- 10.20.193.91:0/3496294254 wait complete. 2026-02-13T01:23:23.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.615+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f6370005b40 con 0x7f63ac10e780 2026-02-13T01:23:23.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.619+0000 7f639b7fe6c0 1 -- 10.20.193.91:0/2524656442 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7f639c035040 con 0x7f63ac10e780 2026-02-13T01:23:23.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.621 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f638403f820 msgr2=0x7f638405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f638403f820 0x7f638405fcd0 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6394004770 tx=0x7f6394006c90 comp rx=0 tx=0).stop 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 msgr2=0x7f63ac0607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac0607f0 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639c032fd0 tx=0x7f639c005820 comp rx=0 tx=0).stop 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 shutdown_connections 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f638403f820 0x7f638405fcd0 unknown :-1 s=CLOSED pgs=36 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63ac10e780 0x7f63ac0607f0 unknown :-1 s=CLOSED pgs=126 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63ac10ddd0 0x7f63ac062330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.622+0000 7f63b0bfd6c0 1 --2- 10.20.193.91:0/2524656442 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63ac10cc50 0x7f63ac061ce0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.623+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 >> 10.20.193.91:0/2524656442 conn(0x7f63ac0ea370 msgr2=0x7f63ac0561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.623+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 shutdown_connections 2026-02-13T01:23:23.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.623+0000 7f63b0bfd6c0 1 -- 10.20.193.91:0/2524656442 wait complete. 2026-02-13T01:23:23.636 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.644+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1ae00055c0 con 0x7f1b1810eed0 2026-02-13T01:23:23.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.647+0000 7f1af7fff6c0 1 -- 10.20.193.91:0/640441538 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f1b0c030030 con 0x7f1b1810eed0 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1aec03f820 msgr2=0x7f1aec05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1aec03f820 0x7f1aec05fcd0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b00004750 tx=0x7f1b00009260 comp rx=0 tx=0).stop 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 msgr2=0x7f1b180f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 0x7f1b180f8580 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0c0092b0 tx=0x7f1b0c0046b0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 shutdown_connections 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1aec03f820 0x7f1aec05fcd0 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b18110a00 0x7f1b180f8de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b18110050 0x7f1b18171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 --2- 10.20.193.91:0/640441538 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1810eed0 0x7f1b180f8580 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 >> 10.20.193.91:0/640441538 conn(0x7f1b180ec5f0 msgr2=0x7f1b180eeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 shutdown_connections 2026-02-13T01:23:23.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.650+0000 7f1af5ffb6c0 1 -- 10.20.193.91:0/640441538 wait complete. 2026-02-13T01:23:23.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.661+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f03d010cb80 con 0x7f03d0064800 2026-02-13T01:23:23.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.664+0000 7f03ccff96c0 1 -- 10.20.193.91:0/926465462 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v36)=0 v36) ==== 129+0+0 (secure 0 0 0) 0x7f03c4035890 con 0x7f03d0064800 2026-02-13T01:23:23.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03a803f7a0 msgr2=0x7f03a805fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03a803f7a0 0x7f03a805fc50 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03bc004750 tx=0x7f03bc009630 comp rx=0 tx=0).stop 2026-02-13T01:23:23.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 msgr2=0x7f03d010a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d010a500 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03c4006c20 tx=0x7f03c4003810 comp rx=0 tx=0).stop 2026-02-13T01:23:23.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 shutdown_connections 2026-02-13T01:23:23.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03a803f7a0 0x7f03a805fc50 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03d0064800 0x7f03d010a500 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d0063e50 0x7f03d0109910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 --2- 10.20.193.91:0/926465462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03d0062cd0 0x7f03d01092c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 >> 10.20.193.91:0/926465462 conn(0x7f03d00ec5f0 msgr2=0x7f03d00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 shutdown_connections 2026-02-13T01:23:23.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.668+0000 7f03d5be36c0 1 -- 10.20.193.91:0/926465462 wait complete. 2026-02-13T01:23:23.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.680+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f35b4172860 con 0x7f35b410cc50 2026-02-13T01:23:23.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.683+0000 7f359b7fe6c0 1 -- 10.20.193.91:0/303696726 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v37)=0 v37) ==== 125+0+0 (secure 0 0 0) 0x7f35a80358d0 con 0x7f35b410cc50 2026-02-13T01:23:23.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f358c03f820 msgr2=0x7f358c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f358c03f820 0x7f358c05fcd0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f359c0095c0 tx=0x7f359c009260 comp rx=0 tx=0).stop 2026-02-13T01:23:23.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410cc50 msgr2=0x7f35b4061ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:23.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410cc50 0x7f35b4061ce0 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35a802f230 tx=0x7f35a8004570 comp rx=0 tx=0).stop 2026-02-13T01:23:23.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 shutdown_connections 2026-02-13T01:23:23.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f358c03f820 0x7f358c05fcd0 unknown :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f35b410e780 0x7f35b40607f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35b410ddd0 0x7f35b4062330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 --2- 10.20.193.91:0/303696726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f35b410cc50 0x7f35b4061ce0 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:23.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 >> 10.20.193.91:0/303696726 conn(0x7f35b40ea370 msgr2=0x7f35b40561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:23.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 shutdown_connections 2026-02-13T01:23:23.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:23.687+0000 7f35b8ed56c0 1 -- 10.20.193.91:0/303696726 wait complete. 2026-02-13T01:23:23.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.700 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.700 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.700 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.702 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.702 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.718 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.732 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.733 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '7155d718-087a-11f1-982a-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial091') 2026-02-13T01:23:23.733 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config dump 2026-02-13T01:23:23.889 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: Optimize plan auto_2026-02-13_01:23:21, mode upmap, max misplaced 0.050000 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: No pools available 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial091=x;trial126=y;trial154=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1627299997' entity='client.admin' 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.912 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial126", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1524004859' entity='client.admin' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/254587136' entity='client.admin' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2452284687' entity='client.admin' 2026-02-13T01:23:23.913 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3626458877' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/683503738' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2019957873' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1559040191' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1255211260' entity='client.admin' 2026-02-13T01:23:23.914 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2268745143' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1670426558' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/665987765' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? ' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2326229791' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3610584173' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/350296287' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3496294254' entity='client.admin' 2026-02-13T01:23:23.915 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2524656442' entity='client.admin' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/640441538' entity='client.admin' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/926465462' entity='client.admin' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/303696726' entity='client.admin' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:23.916 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- 10.20.193.91:0/3365019626 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb248114190 msgr2=0x7fb248119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/3365019626 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb248114190 0x7fb248119140 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=1683365947647220471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb238009970 tx=0x7fb23802ed50 comp rx=0 tx=0).stop 2026-02-13T01:23:24.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- 10.20.193.91:0/3365019626 shutdown_connections 2026-02-13T01:23:24.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/3365019626 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb2481198f0 0x7fb24817a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/3365019626 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb248114190 0x7fb248119140 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=1683365947647220471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/3365019626 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2481137a0 0x7fb248113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- 10.20.193.91:0/3365019626 >> 10.20.193.91:0/3365019626 conn(0x7fb248060760 msgr2=0x7fb248060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- 10.20.193.91:0/3365019626 shutdown_connections 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- 10.20.193.91:0/3365019626 wait complete. 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 Processor -- start 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- start start 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2481137a0 0x7fb248121830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 0x7fb248121d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb248127130 0x7fb2481275d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb248127b10 con 0x7fb2481198f0 2026-02-13T01:23:24.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb248127c80 con 0x7fb248127130 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb24e8886c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb248127e40 con 0x7fb2481137a0 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 0x7fb248121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 0x7fb248121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:52106/0 (socket says 10.20.193.91:52106) 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 -- 10.20.193.91:0/349413372 learned_addr learned my addr 10.20.193.91:0/349413372 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 -- 10.20.193.91:0/349413372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2481137a0 msgr2=0x7fb248121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2481137a0 0x7fb248121830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 -- 10.20.193.91:0/349413372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb248127130 msgr2=0x7fb2481275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb248127130 0x7fb2481275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 -- 10.20.193.91:0/349413372 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238009590 con 0x7fb2481198f0 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.010+0000 7fb2477fe6c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 0x7fb248121d70 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb238009290 tx=0x7fb23802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb238002ae0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb238002c40 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb2380372f0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2481682c0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2481686f0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2481149e0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.011+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fb2380071c0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.012+0000 7fb2457fa6c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb21c03f820 0x7fb21c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.012+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb2380756c0 con 0x7fb2481198f0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.012+0000 7fb247fff6c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb21c03f820 0x7fb21c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.012+0000 7fb247fff6c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb21c03f820 0x7fb21c05fcd0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb234004750 tx=0x7fb234005d30 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:24.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.014+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb238031660 con 0x7fb2481198f0 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: Optimize plan auto_2026-02-13_01:23:21, mode upmap, max misplaced 0.050000 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: No pools available 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial091=x;trial126=y;trial154=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1627299997' entity='client.admin' 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.034 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial126", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1524004859' entity='client.admin' 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/254587136' entity='client.admin' 2026-02-13T01:23:24.035 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2452284687' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3626458877' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/683503738' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2019957873' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1559040191' entity='client.admin' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.036 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1255211260' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2268745143' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1670426558' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/665987765' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2326229791' entity='client.admin' 2026-02-13T01:23:24.037 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3610584173' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/350296287' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3496294254' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2524656442' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/640441538' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/926465462' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/303696726' entity='client.admin' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:24.038 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:24.039 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: Optimize plan auto_2026-02-13_01:23:21, mode upmap, max misplaced 0.050000 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: No pools available 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.14196 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial091=x;trial126=y;trial154=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1627299997' entity='client.admin' 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial126", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial154", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1524004859' entity='client.admin' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial091", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/254587136' entity='client.admin' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2452284687' entity='client.admin' 2026-02-13T01:23:24.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3626458877' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/683503738' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2019957873' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1559040191' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1255211260' entity='client.admin' 2026-02-13T01:23:24.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2268745143' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1670426558' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/665987765' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? ' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2326229791' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3610584173' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/350296287' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3496294254' entity='client.admin' 2026-02-13T01:23:24.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2524656442' entity='client.admin' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/640441538' entity='client.admin' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/926465462' entity='client.admin' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/303696726' entity='client.admin' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:24.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:24.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.107+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb248122a10 con 0x7fb2481198f0 2026-02-13T01:23:24.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.107+0000 7fb2457fa6c0 1 -- 10.20.193.91:0/349413372 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+19758 (secure 0 0 0) 0x7fb238031660 con 0x7fb2481198f0 2026-02-13T01:23:24.107 INFO:teuthology.orchestra.run.trial091.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T01:23:24.107 INFO:teuthology.orchestra.run.trial091.stdout:global dev auth_debug true 2026-02-13T01:23:24.107 INFO:teuthology.orchestra.run.trial091.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T01:23:24.107 INFO:teuthology.orchestra.run.trial091.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global basic log_to_file true 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global basic log_to_journald false 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global basic log_to_stderr false 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_allow_pool_delete true 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T01:23:24.108 INFO:teuthology.orchestra.run.trial091.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:global dev ms_die_on_bug true 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:global dev ms_die_on_old_message true 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced debug_mon 20/20 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced debug_ms 1/1 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced debug_paxos 20/20 2026-02-13T01:23:24.109 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced client_mount_timeout 30 2026-02-13T01:23:24.110 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced debug_cephsqlite 20/20 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced debug_client 20/20 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced debug_mgr 20/20 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced debug_ms 1/1 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mgr/snap_schedule/log_level debug 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T01:23:24.111 INFO:teuthology.orchestra.run.trial091.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd dev bdev_debug_aio true 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced debug_bluefs 20/20 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced debug_bluestore 20/20 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced debug_ms 1/1 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced debug_osd 20/20 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_op_order true 2026-02-13T01:23:24.112 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_shutdown true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_max_omap_entries_per_request 10000 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T01:23:24.113 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced debug_mds 20/20 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced debug_ms 2/2 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-13T01:23:24.114 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_bal_split_size 100 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds dev mds_debug_frag true 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds dev mds_debug_scatterstat true 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced mds_use_global_snaprealm_seq_for_subvol false 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds dev mds_verify_scatter true 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T01:23:24.115 INFO:teuthology.orchestra.run.trial091.stdout:client advanced client_mount_timeout 600 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client advanced debug_client 20/20 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client advanced debug_ms 1/1 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T01:23:24.116 INFO:teuthology.orchestra.run.trial091.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb21c03f820 msgr2=0x7fb21c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb21c03f820 0x7fb21c05fcd0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb234004750 tx=0x7fb234005d30 comp rx=0 tx=0).stop 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 msgr2=0x7fb248121d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 0x7fb248121d70 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb238009290 tx=0x7fb23802fbf0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 shutdown_connections 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb21c03f820 0x7fb21c05fcd0 unknown :-1 s=CLOSED pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb248127130 0x7fb2481275d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb2481198f0 0x7fb248121d70 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 --2- 10.20.193.91:0/349413372 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2481137a0 0x7fb248121830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:24.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 >> 10.20.193.91:0/349413372 conn(0x7fb248060760 msgr2=0x7fb248117fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:24.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 shutdown_connections 2026-02-13T01:23:24.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:24.108+0000 7fb24e8886c0 1 -- 10.20.193.91:0/349413372 wait complete. 2026-02-13T01:23:24.148 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T01:23:24.149 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:23:24.149 DEBUG:teuthology.orchestra.run.trial091:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:23:24.166 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:23:24.166 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_1 2026-02-13T01:23:24.223 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 01:22:57.118086125 +0000 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.224 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.225 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:23:24.287 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T01:23:24.288 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T01:23:24.288 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.00015171 s, 3.4 MB/s 2026-02-13T01:23:24.289 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:23:24.345 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_2 2026-02-13T01:23:24.402 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:23:24.402 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:24.402 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-13T01:23:24.402 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:24.403 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:24.403 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 01:22:57.118086125 +0000 2026-02-13T01:23:24.403 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.403 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.403 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.403 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:23:24.466 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T01:23:24.466 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T01:23:24.466 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000152521 s, 3.4 MB/s 2026-02-13T01:23:24.467 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:23:24.525 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_3 2026-02-13T01:23:24.581 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 01:22:57.118086125 +0000 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.582 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.583 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:23:24.645 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T01:23:24.645 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T01:23:24.645 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000229704 s, 2.2 MB/s 2026-02-13T01:23:24.646 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:23:24.704 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_4 2026-02-13T01:23:24.715 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.509+0000 7fa590904fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-13 01:22:57.118086125 +0000 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.760 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-13 01:20:44.960870474 +0000 2026-02-13T01:23:24.761 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:23:24.822 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-13T01:23:24.822 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-13T01:23:24.822 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000213554 s, 2.4 MB/s 2026-02-13T01:23:24.823 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:23:24.881 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-13T01:23:24.881 DEBUG:teuthology.orchestra.run.trial126:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:23:24.899 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:23:24.899 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_1 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-13 01:23:12.060317737 +0000 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:24.956 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:24.957 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:24.957 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:23:24.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/349413372' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:23:24.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: mgrmap e12: x(active, since 3s) 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:25.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/349413372' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:23:25.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: mgrmap e12: x(active, since 3s) 2026-02-13T01:23:25.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.019 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:25.019 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:25.019 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:25.019 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:25.020 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-13T01:23:25.021 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-13T01:23:25.021 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000173142 s, 3.0 MB/s 2026-02-13T01:23:25.022 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:23:25.068 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/349413372' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: mgrmap e12: x(active, since 3s) 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:25.069 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.767+0000 7fa590904fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.776+0000 7fa590904fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.782+0000 7fa590904fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.788+0000 7fa590904fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.794+0000 7fa590904fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.806+0000 7fa590904fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.831+0000 7fa590904fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.834+0000 7fa590904fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:23:25.070 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.835+0000 7fa590904fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.842+0000 7fa590904fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.879+0000 7fa590904fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.881+0000 7fa590904fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.885+0000 7fa590904fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.887+0000 7fa590904fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.887+0000 7fa590904fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.891+0000 7fa590904fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.892+0000 7fa590904fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.894+0000 7fa590904fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:24.897+0000 7fa590904fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.066+0000 7fa590904fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:23:25.071 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.066+0000 7fa590904fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:23:25.080 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_2 2026-02-13T01:23:25.137 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1318 Links: 1 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-13 01:23:25.110081647 +0000 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.138 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.139 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:23:25.201 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-13T01:23:25.202 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-13T01:23:25.202 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000167401 s, 3.1 MB/s 2026-02-13T01:23:25.203 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:23:25.260 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_3 2026-02-13T01:23:25.275 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 podman[28769]: 2026-02-13 01:23:25.245663641 +0000 UTC m=+0.016292646 container create 440761c4fca2b30fb20173fa26abea02bf69c0a78dfb169d2d3a1974ea950477 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y, org.opencontainers.image.version=10, summary=Rocky Linux Base image, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, ceph=True, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-13 01:23:25.111081630 +0000 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.291 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.291 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:23:25.357 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-13T01:23:25.357 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-13T01:23:25.357 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000162101 s, 3.2 MB/s 2026-02-13T01:23:25.359 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:23:25.418 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_4 2026-02-13T01:23:25.465 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.069+0000 7fa590904fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:23:25.465 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.071+0000 7fa590904fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:23:25.465 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.073+0000 7fa590904fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.073+0000 7fa590904fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.073+0000 7fa590904fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.215+0000 7fa590904fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.245+0000 7fa590904fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.249+0000 7fa590904fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.249+0000 7fa590904fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:23:25.466 INFO:journalctl@ceph.mgr.z.trial154.stdout:Feb 13 01:23:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-z[29371]: 2026-02-13T01:23:25.250+0000 7fa590904fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-13 01:23:25.111081630 +0000 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.474 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-13 01:20:46.841246522 +0000 2026-02-13T01:23:25.475 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:23:25.533 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 podman[28769]: 2026-02-13 01:23:25.278299096 +0000 UTC m=+0.048928111 container init 440761c4fca2b30fb20173fa26abea02bf69c0a78dfb169d2d3a1974ea950477 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause) 2026-02-13T01:23:25.533 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 podman[28769]: 2026-02-13 01:23:25.280555878 +0000 UTC m=+0.051184883 container start 440761c4fca2b30fb20173fa26abea02bf69c0a78dfb169d2d3a1974ea950477 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, name=rockylinux) 2026-02-13T01:23:25.533 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 bash[28769]: 440761c4fca2b30fb20173fa26abea02bf69c0a78dfb169d2d3a1974ea950477 2026-02-13T01:23:25.534 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 podman[28769]: 2026-02-13 01:23:25.23885314 +0000 UTC m=+0.009482155 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:23:25.534 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 systemd[1]: Started Ceph mgr.y for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:23:25.534 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mgr[28829]: -- 10.20.193.126:0/596354630 <== mon.2 v2:10.20.193.126:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ffa765da00 con 0x55ffa7731000 2026-02-13T01:23:25.534 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.304+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T01:23:25.534 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.345+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-13T01:23:25.535 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000151591 s, 3.4 MB/s 2026-02-13T01:23:25.537 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:23:25.593 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-13T01:23:25.593 DEBUG:teuthology.orchestra.run.trial154:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T01:23:25.611 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T01:23:25.611 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_1 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1321 Links: 1 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 01:23:24.278190073 +0000 2026-02-13T01:23:25.668 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 01:20:44.784989280 +0000 2026-02-13T01:23:25.669 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 01:20:44.784989280 +0000 2026-02-13T01:23:25.669 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 01:20:44.784989280 +0000 2026-02-13T01:23:25.669 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T01:23:25.734 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T01:23:25.734 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T01:23:25.734 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000158516 s, 3.2 MB/s 2026-02-13T01:23:25.735 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T01:23:25.792 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_2 2026-02-13T01:23:25.809 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mon[26569]: Standby manager daemon z started 2026-02-13T01:23:25.809 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.809 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.809 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.809 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.809 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.604+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.614+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.620+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.627+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.633+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.645+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.670+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T01:23:25.810 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.673+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.675+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.682+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.720+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.722+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.726+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.728+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.729+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.732+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.733+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.736+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T01:23:25.811 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.738+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T01:23:25.849 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T01:23:25.849 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 01:23:24.278190073 +0000 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:25.850 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:25.850 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T01:23:25.914 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T01:23:25.914 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T01:23:25.914 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000165039 s, 3.1 MB/s 2026-02-13T01:23:25.916 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T01:23:25.973 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_3 2026-02-13T01:23:25.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:25 trial091 ceph-mon[25068]: Standby manager daemon z started 2026-02-13T01:23:25.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:25.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:26.029 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T01:23:26.029 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:26.029 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1313 Links: 1 2026-02-13T01:23:26.029 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:26.029 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:26.030 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 01:23:24.278190073 +0000 2026-02-13T01:23:26.030 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:26.030 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:26.030 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:26.030 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T01:23:26.073 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.922+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T01:23:26.073 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.922+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T01:23:26.073 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.924+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T01:23:26.073 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.927+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T01:23:26.074 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.928+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T01:23:26.074 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.928+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T01:23:26.074 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:25.929+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T01:23:26.074 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:26.072+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T01:23:26.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:25 trial154 ceph-mon[27045]: Standby manager daemon z started 2026-02-13T01:23:26.091 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.091 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.091 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.091 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.091 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:26.093 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T01:23:26.093 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T01:23:26.093 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000239808 s, 2.1 MB/s 2026-02-13T01:23:26.094 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T01:23:26.152 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_4 2026-02-13T01:23:26.209 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T01:23:26.209 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T01:23:26.209 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-13T01:23:26.209 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T01:23:26.209 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T01:23:26.209 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-13 01:23:24.278190073 +0000 2026-02-13T01:23:26.210 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:26.210 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:26.210 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-13 01:20:44.782989310 +0000 2026-02-13T01:23:26.210 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T01:23:26.273 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-13T01:23:26.274 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-13T01:23:26.274 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000220272 s, 2.3 MB/s 2026-02-13T01:23:26.275 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T01:23:26.333 INFO:tasks.cephadm:Deploying osd.0 on trial091 with /dev/vg_nvme/lv_4... 2026-02-13T01:23:26.333 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:23:26.348 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:26.100+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T01:23:26.348 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:26.104+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T01:23:26.348 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:26.105+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T01:23:26.348 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:23:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-y[28817]: 2026-02-13T01:23:26.106+0000 7ffbd5cf3fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T01:23:26.449 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: mgrmap e13: x(active, since 4s), standbys: z 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.782 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: Standby manager daemon y started 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:26.783 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:26.784 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:26.784 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:26 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:26.885 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:23:26.901 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_4 --skip-validation 2026-02-13T01:23:27.018 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:27.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: mgrmap e13: x(active, since 4s), standbys: z 2026-02-13T01:23:27.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: Standby manager daemon y started 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:27.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:26 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3387415188 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e4115410 msgr2=0x7fb5e4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3387415188 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e4115410 0x7fb5e4175db0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=8359053302292560231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d800aa70 tx=0x7fb5d802fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3387415188 shutdown_connections 2026-02-13T01:23:27.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3387415188 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e4115410 0x7fb5e4175db0 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=8359053302292560231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3387415188 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e410fbf0 0x7fb5e4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3387415188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e410f200 0x7fb5e410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3387415188 >> 10.20.193.91:0/3387415188 conn(0x7fb5e40ecb00 msgr2=0x7fb5e410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3387415188 shutdown_connections 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3387415188 wait complete. 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 Processor -- start 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.136+0000 7fb5ec9c46c0 1 -- start start 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 0x7fb5e411d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e4115410 0x7fb5e411d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e4122b00 0x7fb5e4122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4123510 con 0x7fb5e410f200 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4123680 con 0x7fb5e4122b00 2026-02-13T01:23:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4123840 con 0x7fb5e4115410 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 0x7fb5e411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 0x7fb5e411d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60642/0 (socket says 10.20.193.91:60642) 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 -- 10.20.193.91:0/3182958199 learned_addr learned my addr 10.20.193.91:0/3182958199 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5eaf366c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e4122b00 0x7fb5e4122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5e9f346c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e4115410 0x7fb5e411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 -- 10.20.193.91:0/3182958199 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e4115410 msgr2=0x7fb5e411d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e4115410 0x7fb5e411d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 -- 10.20.193.91:0/3182958199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e4122b00 msgr2=0x7fb5e4122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e4122b00 0x7fb5e4122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 -- 10.20.193.91:0/3182958199 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d800a660 con 0x7fb5e410f200 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5e9f346c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e4115410 0x7fb5e411d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5eaf366c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e4122b00 0x7fb5e4122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ea7356c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 0x7fb5e411d200 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5dc00b710 tx=0x7fb5dc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5dc004250 con 0x7fb5e410f200 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb5dc009070 con 0x7fb5e410f200 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e4163cf0 con 0x7fb5e410f200 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5dc00ccd0 con 0x7fb5e410f200 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e4164180 con 0x7fb5e410f200 2026-02-13T01:23:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.137+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e41104d0 con 0x7fb5e410f200 2026-02-13T01:23:27.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.139+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7fb5dc0028c0 con 0x7fb5e410f200 2026-02-13T01:23:27.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.139+0000 7fb5cf7fe6c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5c00b55c0 0x7fb5c00d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.139+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fb5dc0e2110 con 0x7fb5e410f200 2026-02-13T01:23:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.139+0000 7fb5e9f346c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5c00b55c0 0x7fb5c00d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.139+0000 7fb5e9f346c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5c00b55c0 0x7fb5c00d5a70 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e4123b90 tx=0x7fb5d0009630 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.140+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5dc0a6750 con 0x7fb5e410f200 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: mgrmap e13: x(active, since 4s), standbys: z 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: Standby manager daemon y started 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:27.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:26 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:27.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:27.233+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb5e411e3e0 con 0x7fb5c00b55c0 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: mgrmap e14: x(active, since 5s), standbys: z, y 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.119 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.120 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: mgrmap e14: x(active, since 5s), standbys: z, y 2026-02-13T01:23:28.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:23:28.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: mgrmap e14: x(active, since 5s), standbys: z, y 2026-02-13T01:23:28.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T01:23:28.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:28.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:28.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:28.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:29.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:28 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1655233491' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ffbd7ff-7a87-4947-8ce2-ad23813a7754"} : dispatch 2026-02-13T01:23:29.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:28 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1655233491' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ffbd7ff-7a87-4947-8ce2-ad23813a7754"}]': finished 2026-02-13T01:23:29.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:28 trial154 ceph-mon[27045]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:23:29.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:28 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:29.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:28 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2193567599' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:29.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:28 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1655233491' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ffbd7ff-7a87-4947-8ce2-ad23813a7754"} : dispatch 2026-02-13T01:23:29.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:28 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1655233491' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ffbd7ff-7a87-4947-8ce2-ad23813a7754"}]': finished 2026-02-13T01:23:29.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:28 trial091 ceph-mon[25068]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:23:29.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:28 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:29.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:28 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2193567599' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:29.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:28 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1655233491' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ffbd7ff-7a87-4947-8ce2-ad23813a7754"} : dispatch 2026-02-13T01:23:29.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:28 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1655233491' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ffbd7ff-7a87-4947-8ce2-ad23813a7754"}]': finished 2026-02-13T01:23:29.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:28 trial126 ceph-mon[26569]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T01:23:29.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:28 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:28 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2193567599' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:30.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:30 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:23:30.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:30 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:30 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:23:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:30 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:30.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:30 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T01:23:30.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:30 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:32.403 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:32.403 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:32.404 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:32.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:32.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:32.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.109+0000 7fb5cf7fe6c0 1 -- 10.20.193.91:0/3182958199 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb5e411e3e0 con 0x7fb5c00b55c0 2026-02-13T01:23:33.110 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 0 on host 'trial091' 2026-02-13T01:23:33.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5c00b55c0 msgr2=0x7fb5c00d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5c00b55c0 0x7fb5c00d5a70 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e4123b90 tx=0x7fb5d0009630 comp rx=0 tx=0).stop 2026-02-13T01:23:33.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 msgr2=0x7fb5e411d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 0x7fb5e411d200 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5dc00b710 tx=0x7fb5dc00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 shutdown_connections 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5c00b55c0 0x7fb5c00d5a70 unknown :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5e4122b00 0x7fb5e4122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5e4115410 0x7fb5e411d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 --2- 10.20.193.91:0/3182958199 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5e410f200 0x7fb5e411d200 unknown :-1 s=CLOSED pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 >> 10.20.193.91:0/3182958199 conn(0x7fb5e40ecb00 msgr2=0x7fb5e410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 shutdown_connections 2026-02-13T01:23:33.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:33.112+0000 7fb5ec9c46c0 1 -- 10.20.193.91:0/3182958199 wait complete. 2026-02-13T01:23:33.154 DEBUG:teuthology.orchestra.run.trial091:osd.0> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.0.service 2026-02-13T01:23:33.156 INFO:tasks.cephadm:Deploying osd.1 on trial126 with /dev/vg_nvme/lv_4... 2026-02-13T01:23:33.156 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:23:33.275 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:23:33.682 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.682 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.683 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:33.721 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:23:33.741 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_4 --skip-validation 2026-02-13T01:23:33.862 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:23:33.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:33.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:33.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:33.981 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 -- 10.20.193.126:0/3649808904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c10ba30 msgr2=0x7f175c10be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.981 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/3649808904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c10ba30 0x7f175c10be00 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=2914502670609694918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1750009970 tx=0x7f175002ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:33.981 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 -- 10.20.193.126:0/3649808904 shutdown_connections 2026-02-13T01:23:33.981 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/3649808904 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f175c155760 0x7f175c175b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/3649808904 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f175c10c340 0x7f175c155220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/3649808904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c10ba30 0x7f175c10be00 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=2914502670609694918 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 -- 10.20.193.126:0/3649808904 >> 10.20.193.126:0/3649808904 conn(0x7f175c0e9770 msgr2=0x7f175c109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 -- 10.20.193.126:0/3649808904 shutdown_connections 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 -- 10.20.193.126:0/3649808904 wait complete. 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 Processor -- start 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.977+0000 7f1760ee86c0 1 -- start start 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f175c10ba30 0x7f175c1605e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f175c10c340 0x7f175c160b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 0x7f175c165ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.982 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f175c166530 con 0x7f175c10c340 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f175c1666a0 con 0x7f175c155760 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f175c166860 con 0x7f175c10ba30 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 0x7f175c165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 0x7f175c165ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:43982/0 (socket says 10.20.193.126:43982) 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 -- 10.20.193.126:0/1171586663 learned_addr learned my addr 10.20.193.126:0/1171586663 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175a5756c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f175c10ba30 0x7f175c1605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1759d746c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f175c10c340 0x7f175c160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 -- 10.20.193.126:0/1171586663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f175c10ba30 msgr2=0x7f175c1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f175c10ba30 0x7f175c1605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 -- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f175c10c340 msgr2=0x7f175c160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f175c10c340 0x7f175c160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:33.983 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 -- 10.20.193.126:0/1171586663 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1750009590 con 0x7f175c155760 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f175ad766c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 0x7f175c165ee0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c006ea0 tx=0x7f174c00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f174c003a30 con 0x7f175c155760 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c166b40 con 0x7f175c155760 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f174c0054f0 con 0x7f175c155760 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f174c00dcd0 con 0x7f175c155760 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.978+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c1523a0 con 0x7f175c155760 2026-02-13T01:23:33.984 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.979+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c05fb90 con 0x7f175c155760 2026-02-13T01:23:33.985 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.980+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f174c005030 con 0x7f175c155760 2026-02-13T01:23:33.985 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.980+0000 7f17437fe6c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f17340b55c0 0x7f17340d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:33.985 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.980+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1356+0+0 (secure 0 0 0) 0x7f174c0e3080 con 0x7f175c155760 2026-02-13T01:23:33.985 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.980+0000 7f175a5756c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f17340b55c0 0x7f17340d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:33.985 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.981+0000 7f175a5756c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f17340b55c0 0x7f17340d5a70 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17500098c0 tx=0x7f1750005c80 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:33.985 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:33.981+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f174c0a75f0 con 0x7f175c155760 2026-02-13T01:23:34.079 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:34.077+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f175c161730 con 0x7f17340b55c0 2026-02-13T01:23:34.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:34.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:34.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:34.970 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:34.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:34.980 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:34 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0[38787]: 2026-02-13T01:23:34.690+0000 7f422ba776c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T01:23:34.980 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:34 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0[38787]: 2026-02-13T01:23:34.692+0000 7f422793b6c0 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:35.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/461975769' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"} : dispatch 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"} : dispatch 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"}]': finished 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] boot 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:35.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:35 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/3586771870' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:35.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:23:35.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T01:23:35.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/461975769' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"} : dispatch 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"} : dispatch 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"}]': finished 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] boot 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:35 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/3586771870' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:36.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/461975769' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"} : dispatch 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"} : dispatch 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d698ba3-8a17-455c-b05d-8ca1c9d44466"}]': finished 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: osd.0 [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] boot 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T01:23:36.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T01:23:36.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:36.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:35 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/3586771870' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:36 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:23:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:36 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:23:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:36 trial126 ceph-mon[26569]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:36 trial126 ceph-mon[26569]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:36.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:36 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:23:36.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:36 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:23:36.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:36 trial154 ceph-mon[27045]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:36.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:36 trial154 ceph-mon[27045]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:36.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:36 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:23:36.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:36 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:23:36.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:36 trial091 ceph-mon[25068]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:36.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:36 trial091 ceph-mon[25068]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:23:37.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:37 trial154 ceph-mon[27045]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:37.967 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:23:37.968 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.969 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:37 trial126 ceph-mon[26569]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T01:23:37.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:37.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T01:23:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:37.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:37 trial091 ceph-mon[25068]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:38.956 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:38 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:38.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:38 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:38.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:38 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:39.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:39.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:39.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:40.059 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.058+0000 7f17437fe6c0 1 -- 10.20.193.126:0/1171586663 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f175c161730 con 0x7f17340b55c0 2026-02-13T01:23:40.059 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 1 on host 'trial126' 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f17340b55c0 msgr2=0x7f17340d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f17340b55c0 0x7f17340d5a70 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17500098c0 tx=0x7f1750005c80 comp rx=0 tx=0).stop 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 msgr2=0x7f175c165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 0x7f175c165ee0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f174c006ea0 tx=0x7f174c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 shutdown_connections 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f17340b55c0 0x7f17340d5a70 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f175c155760 0x7f175c165ee0 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.062 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f175c10c340 0x7f175c160b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.063 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 --2- 10.20.193.126:0/1171586663 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f175c10ba30 0x7f175c1605e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.063 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 >> 10.20.193.126:0/1171586663 conn(0x7f175c0e9770 msgr2=0x7f175c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:40.063 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 shutdown_connections 2026-02-13T01:23:40.063 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:40.060+0000 7f1760ee86c0 1 -- 10.20.193.126:0/1171586663 wait complete. 2026-02-13T01:23:40.107 DEBUG:teuthology.orchestra.run.trial126:osd.1> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.1.service 2026-02-13T01:23:40.109 INFO:tasks.cephadm:Deploying osd.2 on trial154 with /dev/vg_nvme/lv_4... 2026-02-13T01:23:40.110 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T01:23:40.226 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:23:40.710 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:23:40.728 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_4 --skip-validation 2026-02-13T01:23:40.848 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:23:40.962 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:40.962 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: from='osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:40.963 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- 10.20.193.154:0/3018686032 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810fc20 msgr2=0x7fd738114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/3018686032 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810fc20 0x7fd738114c60 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=6700748302678298473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72c0099a0 tx=0x7fd72c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- 10.20.193.154:0/3018686032 shutdown_connections 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/3018686032 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd738115440 0x7fd738175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/3018686032 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810fc20 0x7fd738114c60 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=6700748302678298473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/3018686032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd73810f230 0x7fd73810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- 10.20.193.154:0/3018686032 >> 10.20.193.154:0/3018686032 conn(0x7fd7380ecb30 msgr2=0x7fd73810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- 10.20.193.154:0/3018686032 shutdown_connections 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- 10.20.193.154:0/3018686032 wait complete. 2026-02-13T01:23:40.972 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 Processor -- start 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- start start 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 0x7fd7380f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd738115440 0x7fd738175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7380f5300 0x7fd7380fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380f59f0 con 0x7fd7380f5300 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380fab10 con 0x7fd738115440 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.968+0000 7fd7400a16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7380facd0 con 0x7fd73810f230 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 0x7fd7380f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 0x7fd7380f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:41306/0 (socket says 10.20.193.154:41306) 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 -- 10.20.193.154:0/2751730683 learned_addr learned my addr 10.20.193.154:0/2751730683 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T01:23:40.973 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73e6136c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7380f5300 0x7fd7380fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 -- 10.20.193.154:0/2751730683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd738115440 msgr2=0x7fd738175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd738115440 0x7fd738175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 -- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7380f5300 msgr2=0x7fd7380fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7380f5300 0x7fd7380fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 -- 10.20.193.154:0/2751730683 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c009590 con 0x7fd73810f230 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd73de126c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 0x7fd7380f4cd0 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72800b740 tx=0x7fd72800bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd728004250 con 0x7fd73810f230 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd728009070 con 0x7fd73810f230 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7380fafb0 con 0x7fd73810f230 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd72800cd70 con 0x7fd73810f230 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7380fb740 con 0x7fd73810f230 2026-02-13T01:23:40.974 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.969+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd738110500 con 0x7fd73810f230 2026-02-13T01:23:40.975 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.971+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7fd7280028c0 con 0x7fd73810f230 2026-02-13T01:23:40.976 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.971+0000 7fd726ffd6c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7140b5640 0x7fd7140d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:40.976 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.971+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1896+0+0 (secure 0 0 0) 0x7fd7280e2160 con 0x7fd73810f230 2026-02-13T01:23:40.976 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.971+0000 7fd73d6116c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7140b5640 0x7fd7140d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:40.976 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.972+0000 7fd73d6116c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7140b5640 0x7fd7140d5af0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72c0092e0 tx=0x7fd72c005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:40.976 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:40.972+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7280a64b0 con 0x7fd73810f230 2026-02-13T01:23:40.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: from='osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:41.072 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:41.070+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd7380f5e20 con 0x7fd7140b5640 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: from='osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:41.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:41.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.968 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:41.968 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:41.968 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:41.968 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:41.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:41.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='client.24268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:42.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:42.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:42.101 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:41 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1[32375]: 2026-02-13T01:23:41.704+0000 7ff1aa8046c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T01:23:42.101 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:41 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1[32375]: 2026-02-13T01:23:41.707+0000 7ff1a26c06c0 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/4037671897' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"} : dispatch 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"} : dispatch 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"}]': finished 2026-02-13T01:23:42.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] boot 2026-02-13T01:23:42.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:23:42.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:42.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/654157205' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:42.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:42.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:42 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:23:42.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:23:42.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/4037671897' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"}]': finished 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] boot 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/654157205' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:42.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:42 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:23:43.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:23:43.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T01:23:43.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/4037671897' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b9d9a44-7956-4117-ada8-cb99016ae048"}]': finished 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: osd.1 [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] boot 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/654157205' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:43.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:43.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:42 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:23:44.089 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:23:44.089 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:44.090 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:43 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:44.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:44.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:44.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:43 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:23:44.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: pgmap v21: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:44.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:43 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.948 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:44 trial154 ceph-mon[27045]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:44.948 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:44 trial154 ceph-mon[27045]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:44.948 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:44 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:23:44.948 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:44 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:44.948 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:44 trial154 ceph-mon[27045]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:45.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:44 trial091 ceph-mon[25068]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:45.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:44 trial091 ceph-mon[25068]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:45.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:44 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:23:45.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:44 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:44 trial091 ceph-mon[25068]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:45.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:44 trial126 ceph-mon[26569]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:45.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:44 trial126 ceph-mon[26569]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:45.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:44 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T01:23:45.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:44 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:45.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:44 trial126 ceph-mon[26569]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:46.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:45 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:46.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:45 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:46.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:45 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:47.043 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.041+0000 7fd726ffd6c0 1 -- 10.20.193.154:0/2751730683 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd7380f5e20 con 0x7fd7140b5640 2026-02-13T01:23:47.043 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 2 on host 'trial154' 2026-02-13T01:23:47.045 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7140b5640 msgr2=0x7fd7140d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7140b5640 0x7fd7140d5af0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72c0092e0 tx=0x7fd72c005c60 comp rx=0 tx=0).stop 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 msgr2=0x7fd7380f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 0x7fd7380f4cd0 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd72800b740 tx=0x7fd72800bc10 comp rx=0 tx=0).stop 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 shutdown_connections 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7140b5640 0x7fd7140d5af0 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd7380f5300 0x7fd7380fa5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd738115440 0x7fd738175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 --2- 10.20.193.154:0/2751730683 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd73810f230 0x7fd7380f4cd0 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 >> 10.20.193.154:0/2751730683 conn(0x7fd7380ecb30 msgr2=0x7fd738113da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.046 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 shutdown_connections 2026-02-13T01:23:47.047 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:23:47.043+0000 7fd7400a16c0 1 -- 10.20.193.154:0/2751730683 wait complete. 2026-02-13T01:23:47.087 DEBUG:teuthology.orchestra.run.trial154:osd.2> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.2.service 2026-02-13T01:23:47.089 INFO:tasks.cephadm:Deploying osd.3 on trial091 with /dev/vg_nvme/lv_3... 2026-02-13T01:23:47.090 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:23:47.138 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:47.138 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.138 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.139 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:47.139 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.139 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.139 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.140 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:47.140 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.140 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:47.140 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:47.140 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:46 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.211 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:47.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:47.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:47.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:46 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:47.666 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:23:47.683 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_3 --skip-validation 2026-02-13T01:23:47.801 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:23:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- 10.20.193.91:0/2070935122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1881556e0 msgr2=0x7ff188175ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/2070935122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1881556e0 0x7ff188175ac0 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=14258558703957774091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff18400aa40 tx=0x7ff18402fde0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- 10.20.193.91:0/2070935122 shutdown_connections 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/2070935122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1881556e0 0x7ff188175ac0 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=14258558703957774091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/2070935122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188061030 0x7ff1881551a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/2070935122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff188060720 0x7ff188060af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- 10.20.193.91:0/2070935122 >> 10.20.193.91:0/2070935122 conn(0x7ff1880ea8b0 msgr2=0x7ff18810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- 10.20.193.91:0/2070935122 shutdown_connections 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- 10.20.193.91:0/2070935122 wait complete. 2026-02-13T01:23:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 Processor -- start 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- start start 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188060720 0x7ff188161510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 0x7ff188161a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1881556e0 0x7ff188166e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff188167460 con 0x7ff188061030 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff1881675d0 con 0x7ff188060720 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18ed356c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff188167790 con 0x7ff1881556e0 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff17ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 0x7ff188161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff17ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 0x7ff188161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:53124/0 (socket says 10.20.193.91:53124) 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff17ffff6c0 1 -- 10.20.193.91:0/1272619864 learned_addr learned my addr 10.20.193.91:0/1272619864 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:23:47.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.928+0000 7ff18d2a76c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1881556e0 0x7ff188166e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff18caa66c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188060720 0x7ff188161510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17ffff6c0 1 -- 10.20.193.91:0/1272619864 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1881556e0 msgr2=0x7ff188166e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17ffff6c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1881556e0 0x7ff188166e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17ffff6c0 1 -- 10.20.193.91:0/1272619864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188060720 msgr2=0x7ff188161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17ffff6c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188060720 0x7ff188161510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17ffff6c0 1 -- 10.20.193.91:0/1272619864 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18400a660 con 0x7ff188061030 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff18caa66c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188060720 0x7ff188161510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17ffff6c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 0x7ff188161a50 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff170005dc0 tx=0x7ff17000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff170004250 con 0x7ff188061030 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff170009070 con 0x7ff188061030 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff188167a70 con 0x7ff188061030 2026-02-13T01:23:47.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff17000cd70 con 0x7ff188061030 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff188151310 con 0x7ff188061030 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.929+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188061c30 con 0x7ff188061030 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.931+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7ff1700028c0 con 0x7ff188061030 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.931+0000 7ff17dffb6c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1640b55c0 0x7ff1640d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.931+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2436+0+0 (secure 0 0 0) 0x7ff1700e2410 con 0x7ff188061030 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.931+0000 7ff18caa66c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1640b55c0 0x7ff1640d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.932+0000 7ff18caa66c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1640b55c0 0x7ff1640d5a70 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff178005980 tx=0x7ff178005df0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:47.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:47.932+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1700a6540 con 0x7ff188061030 2026-02-13T01:23:47.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: from='osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:47.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:48.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:48.027+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff1881626c0 con 0x7ff1640b55c0 2026-02-13T01:23:48.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: from='osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:48.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: from='osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T01:23:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:23:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:48.930 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:23:48.930 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:23:48.930 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:23:48.930 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:48.930 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:23:48.930 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.931 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1604485089' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bb667b65-2ce1-4131-88de-53efa7c8fb94"} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1604485089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb667b65-2ce1-4131-88de-53efa7c8fb94"}]': finished 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: osdmap e15: 4 total, 2 up, 4 in 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:48.932 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:49.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:48 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2[33155]: 2026-02-13T01:23:48.837+0000 7fda85caa6c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T01:23:49.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:48 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2[33155]: 2026-02-13T01:23:48.841+0000 7fda7db666c0 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:49.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:23:49.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:49.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1604485089' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bb667b65-2ce1-4131-88de-53efa7c8fb94"} : dispatch 2026-02-13T01:23:49.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:23:49.219 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1604485089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb667b65-2ce1-4131-88de-53efa7c8fb94"}]': finished 2026-02-13T01:23:49.219 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: osdmap e15: 4 total, 2 up, 4 in 2026-02-13T01:23:49.219 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:49.219 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:49.219 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:49.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:49.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1604485089' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bb667b65-2ce1-4131-88de-53efa7c8fb94"} : dispatch 2026-02-13T01:23:49.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:23:49.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1604485089' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb667b65-2ce1-4131-88de-53efa7c8fb94"}]': finished 2026-02-13T01:23:49.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: osdmap e15: 4 total, 2 up, 4 in 2026-02-13T01:23:49.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:49.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:49.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3133881931' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:50.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:50.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:23:50.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] boot 2026-02-13T01:23:50.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T01:23:50.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:50.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3133881931' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:50.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:50.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:23:50.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] boot 2026-02-13T01:23:50.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T01:23:50.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:50.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3133881931' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:50.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:50.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:23:50.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: osd.2 [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] boot 2026-02-13T01:23:50.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T01:23:50.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T01:23:50.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:51.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:23:51.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.130 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:23:51.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:23:51.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:51.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.976 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: pgmap v33: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: pgmap v34: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:51 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:52.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: pgmap v33: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:52.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: pgmap v34: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:52.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:23:52.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:52.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:23:52.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:52.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:52.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:51 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:52.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: pgmap v33: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:52.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: pgmap v34: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:52.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T01:23:52.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:52.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T01:23:52.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:52.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:52.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:51 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:53.074 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:52 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:53.074 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:53.074 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:52 trial091 ceph-mon[25068]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:23:53.075 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:53.075 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:53.075 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45074]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:23:53.075 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45074]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.075 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.075 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44978]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:23:53.075 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44978]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.076 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.076 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44978]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.076 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44982]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:23:53.076 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44982]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.076 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.076 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:23:52 trial091 sudo[44982]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.154 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:52 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:53.154 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:53.154 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:52 trial126 ceph-mon[26569]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:23:53.154 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:53.154 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35527]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35527]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35527]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35531]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.155 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:52 trial126 sudo[35531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.156 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35531]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.179 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45074]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.179 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45083]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:23:53.179 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45083]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.179 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.179 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 sudo[45083]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.215 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36434]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36434]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36434]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.216 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36438]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:52 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:52 trial154 ceph-mon[27045]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36442]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36442]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36442]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36446]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36446]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 sudo[36446]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35535]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T01:23:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35535]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35535]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:53.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35539]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T01:23:53.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35539]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T01:23:53.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T01:23:53.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 sudo[35539]: pam_unix(sudo:session): session closed for user root 2026-02-13T01:23:54.169 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.170 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.171 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: pgmap v39: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.172 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:54.173 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:54.173 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: pgmap v39: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:54.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.260 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.261+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff1700a6160 con 0x7ff188061030 2026-02-13T01:23:54.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.312+0000 7ff17dffb6c0 1 -- 10.20.193.91:0/1272619864 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff1881626c0 con 0x7ff1640b55c0 2026-02-13T01:23:54.311 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 3 on host 'trial091' 2026-02-13T01:23:54.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1640b55c0 msgr2=0x7ff1640d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1640b55c0 0x7ff1640d5a70 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff178005980 tx=0x7ff178005df0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 msgr2=0x7ff188161a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:54.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 0x7ff188161a50 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff170005dc0 tx=0x7ff17000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 shutdown_connections 2026-02-13T01:23:54.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1640b55c0 0x7ff1640d5a70 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1881556e0 0x7ff188166e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff188061030 0x7ff188161a50 unknown :-1 s=CLOSED pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 --2- 10.20.193.91:0/1272619864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff188060720 0x7ff188161510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:54.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.314+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 >> 10.20.193.91:0/1272619864 conn(0x7ff1880ea8b0 msgr2=0x7ff18810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:54.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.315+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 shutdown_connections 2026-02-13T01:23:54.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:23:54.315+0000 7ff18ed356c0 1 -- 10.20.193.91:0/1272619864 wait complete. 2026-02-13T01:23:54.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:23:54.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T01:23:54.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: pgmap v39: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:54.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:54.360 DEBUG:teuthology.orchestra.run.trial091:osd.3> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.3.service 2026-02-13T01:23:54.362 INFO:tasks.cephadm:Deploying osd.4 on trial126 with /dev/vg_nvme/lv_3... 2026-02-13T01:23:54.362 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:23:54.483 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:23:54.946 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:23:54.965 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_3 --skip-validation 2026-02-13T01:23:55.081 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:23:55.139 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: pgmap v40: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:55.139 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:23:55.139 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:55.139 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:23:55.140 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:55.140 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:23:55.140 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: mgrmap e15: x(active, since 32s), standbys: z, y 2026-02-13T01:23:55.140 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:55.140 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:55.140 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/2547466955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b810f200 msgr2=0x7fd1b810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/2547466955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b810f200 0x7fd1b810f5d0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=16076230504626580486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a4009970 tx=0x7fd1a402ed20 comp rx=0 tx=0).stop 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/2547466955 shutdown_connections 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/2547466955 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd1b8115410 0x7fd1b8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/2547466955 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd1b810fbf0 0x7fd1b8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/2547466955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b810f200 0x7fd1b810f5d0 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=16076230504626580486 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/2547466955 >> 10.20.193.126:0/2547466955 conn(0x7fd1b80ecb00 msgr2=0x7fd1b810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:23:55.199 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/2547466955 shutdown_connections 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/2547466955 wait complete. 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 Processor -- start 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 -- start start 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.195+0000 7fd1bdadc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd1b810f200 0x7fd1b811d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 0x7fd1b811d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd1b8122bf0 0x7fd1b8123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8123600 con 0x7fd1b810f200 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8123770 con 0x7fd1b8115410 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b8123930 con 0x7fd1b8122bf0 2026-02-13T01:23:55.200 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 0x7fd1b811d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 0x7fd1b811d830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:39362/0 (socket says 10.20.193.126:39362) 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 -- 10.20.193.126:0/481659238 learned_addr learned my addr 10.20.193.126:0/481659238 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b77fe6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd1b810f200 0x7fd1b811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b7fff6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd1b8122bf0 0x7fd1b8123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 -- 10.20.193.126:0/481659238 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd1b8122bf0 msgr2=0x7fd1b8123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd1b8122bf0 0x7fd1b8123090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 -- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd1b810f200 msgr2=0x7fd1b811d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd1b810f200 0x7fd1b811d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 -- 10.20.193.126:0/481659238 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a4009590 con 0x7fd1b8115410 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b6ffd6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 0x7fd1b811d830 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a800b750 tx=0x7fd1a800bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd1a8004a80 con 0x7fd1b8115410 2026-02-13T01:23:55.201 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd1a8009030 con 0x7fd1b8115410 2026-02-13T01:23:55.202 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b8163de0 con 0x7fd1b8115410 2026-02-13T01:23:55.202 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd1a800cd00 con 0x7fd1b8115410 2026-02-13T01:23:55.202 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b8164270 con 0x7fd1b8115410 2026-02-13T01:23:55.202 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.196+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b81104d0 con 0x7fd1b8115410 2026-02-13T01:23:55.202 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.198+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fd1a8005020 con 0x7fd1b8115410 2026-02-13T01:23:55.203 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.198+0000 7fd1b4ff96c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd18c0b5650 0x7fd18c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:23:55.203 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.198+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3365+0+0 (secure 0 0 0) 0x7fd1a80e2970 con 0x7fd1b8115410 2026-02-13T01:23:55.203 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.198+0000 7fd1b77fe6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd18c0b5650 0x7fd18c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:23:55.203 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.199+0000 7fd1b77fe6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd18c0b5650 0x7fd18c0d5b00 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a4005b40 tx=0x7fd1a4005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:23:55.203 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.199+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd1a80a6620 con 0x7fd1b8115410 2026-02-13T01:23:55.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: pgmap v40: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:55.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:23:55.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: mgrmap e15: x(active, since 32s), standbys: z, y 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:55.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: pgmap v40: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: mgrmap e15: x(active, since 32s), standbys: z, y 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:55.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:55.296 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:23:55.295+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd1b811e4a0 con 0x7fd18c0b5650 2026-02-13T01:23:56.199 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.200 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.201 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: pgmap v44: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T01:23:56.202 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:56.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:56.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:56.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: pgmap v44: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:23:56.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T01:23:56.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:56.228 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:23:55 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3[45177]: 2026-02-13T01:23:55.911+0000 7fa4ff7726c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T01:23:56.228 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:23:55 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3[45177]: 2026-02-13T01:23:55.915+0000 7fa4fb6366c0 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: pgmap v44: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T01:23:56.231 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/1826519316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"} : dispatch 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"} : dispatch 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"}]': finished 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] boot 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/1726878631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:57.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:56 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:23:57.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/1826519316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"} : dispatch 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"} : dispatch 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"}]': finished 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] boot 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/1726878631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:57.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:56 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:23:57.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/1826519316' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"} : dispatch 2026-02-13T01:23:57.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"} : dispatch 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2569ae9-0cac-4935-94f5-bfcbd0376cb7"}]': finished 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: osd.3 [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] boot 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/1726878631' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:23:57.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:56 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:23:58.364 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:23:58.364 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:23:58.364 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:23:58.364 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: pgmap v48: 1 pgs: 1 creating+peering; 0 B data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:58.365 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:58.366 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:58.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: pgmap v48: 1 pgs: 1 creating+peering; 0 B data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:58.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:58.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:58.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: pgmap v48: 1 pgs: 1 creating+peering; 0 B data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:23:58.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:23:58.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:23:58.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:23:58.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:59.215 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: pgmap v49: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:59.215 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:59.216 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:23:59.216 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:59.216 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:23:59.216 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:59.216 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:23:59.216 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:23:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:59.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: pgmap v49: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:23:59.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:23:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:59.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: pgmap v49: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T01:23:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:23:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:00.404 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:00 trial126 ceph-mon[26569]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:00.404 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:00 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:00.404 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:00 trial126 ceph-mon[26569]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:24:00.405 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:00.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:00 trial154 ceph-mon[27045]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:00.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:00 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:00.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:00 trial154 ceph-mon[27045]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:24:00.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:00 trial091 ceph-mon[25068]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:00.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:00 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:00.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:00 trial091 ceph-mon[25068]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T01:24:00.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:01.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:01.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:01.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:01.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:01.505 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.504+0000 7fd1b4ff96c0 1 -- 10.20.193.126:0/481659238 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd1b811e4a0 con 0x7fd18c0b5650 2026-02-13T01:24:01.505 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 4 on host 'trial126' 2026-02-13T01:24:01.508 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd18c0b5650 msgr2=0x7fd18c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.508 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd18c0b5650 0x7fd18c0d5b00 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a4005b40 tx=0x7fd1a4005c00 comp rx=0 tx=0).stop 2026-02-13T01:24:01.508 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 msgr2=0x7fd1b811d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:01.508 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 0x7fd1b811d830 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1a800b750 tx=0x7fd1a800bc20 comp rx=0 tx=0).stop 2026-02-13T01:24:01.508 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 shutdown_connections 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd18c0b5650 0x7fd18c0d5b00 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd1b8122bf0 0x7fd1b8123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd1b8115410 0x7fd1b811d830 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 --2- 10.20.193.126:0/481659238 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd1b810f200 0x7fd1b811d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 >> 10.20.193.126:0/481659238 conn(0x7fd1b80ecb00 msgr2=0x7fd1b810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 shutdown_connections 2026-02-13T01:24:01.509 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:01.507+0000 7fd1bdadc6c0 1 -- 10.20.193.126:0/481659238 wait complete. 2026-02-13T01:24:01.550 DEBUG:teuthology.orchestra.run.trial126:osd.4> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.4.service 2026-02-13T01:24:01.552 INFO:tasks.cephadm:Deploying osd.5 on trial154 with /dev/vg_nvme/lv_3... 2026-02-13T01:24:01.553 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T01:24:01.677 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:02.140 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:24:02.157 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_3 --skip-validation 2026-02-13T01:24:02.276 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: pgmap v55: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: pgmap v56: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: from='osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:02.393 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:02.394 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:02.394 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:02.400 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 -- 10.20.193.154:0/1448648654 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f693410f230 msgr2=0x7f693410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.400 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 --2- 10.20.193.154:0/1448648654 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f693410f230 0x7f693410f600 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=1460811458334798658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69240099a0 tx=0x7f692402ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 -- 10.20.193.154:0/1448648654 shutdown_connections 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 --2- 10.20.193.154:0/1448648654 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6934115440 0x7f6934175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 --2- 10.20.193.154:0/1448648654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f693410fc20 0x7f6934114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 --2- 10.20.193.154:0/1448648654 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f693410f230 0x7f693410f600 unknown :-1 s=CLOSED pgs=34 gs=1 cs=0 l=1 c_cookie=1460811458334798658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 -- 10.20.193.154:0/1448648654 >> 10.20.193.154:0/1448648654 conn(0x7f69340ecb30 msgr2=0x7f693410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 -- 10.20.193.154:0/1448648654 shutdown_connections 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.396+0000 7f693adb86c0 1 -- 10.20.193.154:0/1448648654 wait complete. 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 Processor -- start 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 -- start start 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f693410f230 0x7f693411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.401 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 0x7f693411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6934122b90 0x7f6934123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f69341235a0 con 0x7f693410f230 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6934123710 con 0x7f6934122b90 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f69341238d0 con 0x7f6934115440 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 0x7f693411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 0x7f693411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:56410/0 (socket says 10.20.193.154:56410) 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 -- 10.20.193.154:0/96132142 learned_addr learned my addr 10.20.193.154:0/96132142 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693932e6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6934122b90 0x7f6934123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f6938b2d6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f693410f230 0x7f693411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 -- 10.20.193.154:0/96132142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6934122b90 msgr2=0x7f6934123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6934122b90 0x7f6934123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.402 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 -- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f693410f230 msgr2=0x7f693411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f693410f230 0x7f693411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 -- 10.20.193.154:0/96132142 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6924009590 con 0x7f6934115440 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693932e6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6934122b90 0x7f6934123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f692bfff6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 0x7f693411d7d0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c005dc0 tx=0x7f691c00bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c004250 con 0x7f6934115440 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.397+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6934163d80 con 0x7f6934115440 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.398+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f691c009070 con 0x7f6934115440 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.398+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f691c00cd50 con 0x7f6934115440 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.398+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6934164210 con 0x7f6934115440 2026-02-13T01:24:02.403 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.398+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6934110500 con 0x7f6934115440 2026-02-13T01:24:02.404 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.399+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f691c0028c0 con 0x7f6934115440 2026-02-13T01:24:02.404 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.400+0000 7f6929ffb6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69100b5650 0x7f69100d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:02.404 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.400+0000 7f6938b2d6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69100b5650 0x7f69100d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:02.405 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.400+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3797+0+0 (secure 0 0 0) 0x7f691c0e2b00 con 0x7f6934115440 2026-02-13T01:24:02.405 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.400+0000 7f6938b2d6c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69100b5650 0x7f69100d5b00 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69240023e0 tx=0x7f6924005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:02.405 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.401+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f691c0a6600 con 0x7f6934115440 2026-02-13T01:24:02.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: pgmap v55: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: pgmap v56: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: from='osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:02.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:02.494+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f693411e470 con 0x7f69100b5650 2026-02-13T01:24:02.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: pgmap v55: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:02.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: pgmap v56: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:02.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: from='osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:02.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T01:24:02.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:02.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:02.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:02.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:02.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:03.402 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: pgmap v57: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:03.402 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:24:03.402 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:03.402 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T01:24:03.402 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:03.402 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:03.403 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.404 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.404 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:03.404 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.404 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:03.404 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:03.404 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: pgmap v57: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:03.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:03.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: pgmap v57: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:03.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T01:24:03.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:03.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:03.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:03.601 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:24:03 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4[38608]: 2026-02-13T01:24:03.124+0000 7f0ecb2bb6c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T01:24:03.601 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:24:03 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4[38608]: 2026-02-13T01:24:03.128+0000 7f0ec31776c0 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:04.432 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: pgmap v59: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:04.432 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: osdmap e29: 5 total, 4 up, 5 in 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/4205570783' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"} : dispatch 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"} : dispatch 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"}]': finished 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] boot 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:04.433 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/4089608691' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:04.434 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:04.434 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:04 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:04.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: pgmap v59: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:04.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: osdmap e29: 5 total, 4 up, 5 in 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/4205570783' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"}]': finished 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] boot 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/4089608691' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:04.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:04.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:04 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:04.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: pgmap v59: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: osdmap e29: 5 total, 4 up, 5 in 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/4205570783' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"} : dispatch 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"} : dispatch 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6279cc06-cf48-430f-929b-fde87b33e114"}]': finished 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: osd.4 [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] boot 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T01:24:04.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:04.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/4089608691' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:04.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:04.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:04 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:05.534 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.535 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:05.535 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:05.535 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:24:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:05.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:05.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:05.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:05.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:06.362 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:06 trial154 ceph-mon[27045]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.362 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:06 trial154 ceph-mon[27045]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 190 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.362 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:06 trial154 ceph-mon[27045]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 226 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.362 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:24:06.363 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:06 trial126 ceph-mon[26569]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:06 trial126 ceph-mon[26569]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 190 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:06 trial126 ceph-mon[26569]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 226 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:24:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:06.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:06 trial091 ceph-mon[25068]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 199 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:06 trial091 ceph-mon[25068]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 190 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:06 trial091 ceph-mon[25068]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail; 226 KiB/s, 0 objects/s recovering 2026-02-13T01:24:06.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T01:24:06.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:07.569 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:07 trial154 ceph-mon[27045]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:07.569 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:07 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:07.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:07 trial126 ceph-mon[26569]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:07.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:07 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:07.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:07 trial091 ceph-mon[25068]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:07.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:07 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:08.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:08.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:08.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:08.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:08.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:08.638 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.636+0000 7f6929ffb6c0 1 -- 10.20.193.154:0/96132142 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f6924004430 con 0x7f69100b5650 2026-02-13T01:24:08.638 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 5 on host 'trial154' 2026-02-13T01:24:08.640 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.638+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69100b5650 msgr2=0x7f69100d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.640 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.638+0000 7f693adb86c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69100b5650 0x7f69100d5b00 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69240023e0 tx=0x7f6924005c60 comp rx=0 tx=0).stop 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.638+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 msgr2=0x7f693411d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.638+0000 7f693adb86c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 0x7f693411d7d0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c005dc0 tx=0x7f691c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 shutdown_connections 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69100b5650 0x7f69100d5b00 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6934122b90 0x7f6934123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6934115440 0x7f693411d7d0 unknown :-1 s=CLOSED pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 --2- 10.20.193.154:0/96132142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f693410f230 0x7f693411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 >> 10.20.193.154:0/96132142 conn(0x7f69340ecb30 msgr2=0x7f693410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 shutdown_connections 2026-02-13T01:24:08.641 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:08.639+0000 7f693adb86c0 1 -- 10.20.193.154:0/96132142 wait complete. 2026-02-13T01:24:08.684 DEBUG:teuthology.orchestra.run.trial154:osd.5> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.5.service 2026-02-13T01:24:08.687 INFO:tasks.cephadm:Deploying osd.6 on trial091 with /dev/vg_nvme/lv_2... 2026-02-13T01:24:08.687 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:24:08.712 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:08.712 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.712 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.712 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:08.713 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:08.809 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.285 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:09.303 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_2 --skip-validation 2026-02-13T01:24:09.461 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: from='osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:09.510 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:09.511 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:09 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:09.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- 10.20.193.91:0/3462781825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010fbf0 msgr2=0x7f4290114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- 10.20.193.91:0/3462781825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010fbf0 0x7f4290114c30 secure :-1 s=READY pgs=155 gs=1 cs=0 l=1 c_cookie=14987088598995611863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42800099a0 tx=0x7f428002ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:09.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- 10.20.193.91:0/3462781825 shutdown_connections 2026-02-13T01:24:09.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- 10.20.193.91:0/3462781825 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4290115410 0x7f4290175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- 10.20.193.91:0/3462781825 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010fbf0 0x7f4290114c30 unknown :-1 s=CLOSED pgs=155 gs=1 cs=0 l=1 c_cookie=14987088598995611863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- 10.20.193.91:0/3462781825 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f429010f200 0x7f429010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- 10.20.193.91:0/3462781825 >> 10.20.193.91:0/3462781825 conn(0x7f42900ecb00 msgr2=0x7f429010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- 10.20.193.91:0/3462781825 shutdown_connections 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- 10.20.193.91:0/3462781825 wait complete. 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 Processor -- start 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- start start 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 0x7f42900f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4290115410 0x7f4290175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42900f5320 0x7f42900fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f42900f5a10 con 0x7f429010f200 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f42900faae0 con 0x7f42900f5320 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.587+0000 7f42965446c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f42900faca0 con 0x7f4290115410 2026-02-13T01:24:09.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 0x7f42900f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 0x7f42900f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48072/0 (socket says 10.20.193.91:48072) 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 -- 10.20.193.91:0/2226077752 learned_addr learned my addr 10.20.193.91:0/2226077752 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428f7fe6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4290115410 0x7f4290175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f4294aba6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42900f5320 0x7f42900fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 -- 10.20.193.91:0/2226077752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4290115410 msgr2=0x7f4290175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4290115410 0x7f4290175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 -- 10.20.193.91:0/2226077752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42900f5320 msgr2=0x7f42900fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42900f5320 0x7f42900fa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 -- 10.20.193.91:0/2226077752 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4280009590 con 0x7f429010f200 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428ffff6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 0x7f42900f4cf0 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f427c005dc0 tx=0x7f427c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f427c004250 con 0x7f429010f200 2026-02-13T01:24:09.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f427c009070 con 0x7f429010f200 2026-02-13T01:24:09.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f427c00cde0 con 0x7f429010f200 2026-02-13T01:24:09.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42900faf80 con 0x7f429010f200 2026-02-13T01:24:09.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42900fb410 con 0x7f429010f200 2026-02-13T01:24:09.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.588+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42901104d0 con 0x7f429010f200 2026-02-13T01:24:09.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.590+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f427c0028c0 con 0x7f429010f200 2026-02-13T01:24:09.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.590+0000 7f428d7fa6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f42640b56d0 0x7f42640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:09.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.590+0000 7f428f7fe6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f42640b56d0 0x7f42640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:09.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.590+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4229+0+0 (secure 0 0 0) 0x7f427c0e2a10 con 0x7f429010f200 2026-02-13T01:24:09.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.591+0000 7f428f7fe6c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f42640b56d0 0x7f42640d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4280005b40 tx=0x7f4280005c40 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:09.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.591+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f427c0a6360 con 0x7f429010f200 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: from='osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:09.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:09.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:09 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:09.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:09.686+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f42900fb410 con 0x7f42640b56d0 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: from='osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:09.699 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:09.700 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:09 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.562 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.563 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.564 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.564 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:24:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:24:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:10.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:10.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:10.718 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:24:10 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:24:10.327+0000 7fa16ef6d6c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T01:24:10.718 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:24:10 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:24:10.331+0000 7fa166e296c0 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:11.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:11.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:11.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: osdmap e33: 6 total, 5 up, 6 in 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/208712625' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47579bf9-6170-4408-810f-8be850659d05"} : dispatch 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/208712625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47579bf9-6170-4408-810f-8be850659d05"}]': finished 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] boot 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:11.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:11 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1224019283' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: osdmap e33: 6 total, 5 up, 6 in 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/208712625' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47579bf9-6170-4408-810f-8be850659d05"} : dispatch 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/208712625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47579bf9-6170-4408-810f-8be850659d05"}]': finished 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] boot 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:11.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:11 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1224019283' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: osdmap e33: 6 total, 5 up, 6 in 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/208712625' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "47579bf9-6170-4408-810f-8be850659d05"} : dispatch 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/208712625' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47579bf9-6170-4408-810f-8be850659d05"}]': finished 2026-02-13T01:24:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: osd.5 [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] boot 2026-02-13T01:24:11.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T01:24:11.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T01:24:11.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:11.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:11.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:11.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:11 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1224019283' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:12.743 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.744 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:12.744 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:12.744 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:24:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:12.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:12.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:12.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:24:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:24:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:13.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:13.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T01:24:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T01:24:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:14.751 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:14 trial091 ceph-mon[25068]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T01:24:14.751 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:14 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:14.751 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:14 trial091 ceph-mon[25068]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:24:14.751 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:14 trial126 ceph-mon[26569]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T01:24:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:14 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:14 trial126 ceph-mon[26569]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:24:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:14 trial154 ceph-mon[27045]: pgmap v79: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T01:24:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:14 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:14 trial154 ceph-mon[27045]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T01:24:14.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:15 trial091 ceph-mon[25068]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:24:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:15.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:15 trial126 ceph-mon[26569]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:24:15.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:15.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:15.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:15.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:15 trial154 ceph-mon[27045]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T01:24:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:15.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.024+0000 7f428d7fa6c0 1 -- 10.20.193.91:0/2226077752 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f42900fb410 con 0x7f42640b56d0 2026-02-13T01:24:16.024 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 6 on host 'trial091' 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f42640b56d0 msgr2=0x7f42640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f42640b56d0 0x7f42640d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4280005b40 tx=0x7f4280005c40 comp rx=0 tx=0).stop 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 msgr2=0x7f42900f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 0x7f42900f4cf0 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f427c005dc0 tx=0x7f427c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 shutdown_connections 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f42640b56d0 0x7f42640d5b80 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42900f5320 0x7f42900fa5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4290115410 0x7f4290175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 --2- 10.20.193.91:0/2226077752 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f429010f200 0x7f42900f4cf0 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 >> 10.20.193.91:0/2226077752 conn(0x7f42900ecb00 msgr2=0x7f4290111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:16.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 shutdown_connections 2026-02-13T01:24:16.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:16.026+0000 7f42965446c0 1 -- 10.20.193.91:0/2226077752 wait complete. 2026-02-13T01:24:16.093 DEBUG:teuthology.orchestra.run.trial091:osd.6> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.6.service 2026-02-13T01:24:16.095 INFO:tasks.cephadm:Deploying osd.7 on trial126 with /dev/vg_nvme/lv_2... 2026-02-13T01:24:16.096 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:24:16.218 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: pgmap v82: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 215 KiB/s, 0 objects/s recovering 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:16.634 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.635 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: pgmap v82: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 215 KiB/s, 0 objects/s recovering 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:16.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.638 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:16.681 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:24:16.698 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_2 --skip-validation 2026-02-13T01:24:16.817 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:24:16.938 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3686079502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112b10 msgr2=0x7fbaf810b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.938 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3686079502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112b10 0x7fbaf810b1f0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=3269145686513355719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbae8009970 tx=0x7fbae802ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3686079502 shutdown_connections 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3686079502 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbaf810c4e0 0x7fbaf810c980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3686079502 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf8112fc0 0x7fbaf810b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3686079502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112b10 0x7fbaf810b1f0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=3269145686513355719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3686079502 >> 10.20.193.126:0/3686079502 conn(0x7fbaf8063af0 msgr2=0x7fbaf80642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3686079502 shutdown_connections 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.935+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3686079502 wait complete. 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 Processor -- start 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 -- start start 2026-02-13T01:24:16.939 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf810c4e0 0x7fbaf8122e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbaf8112b10 0x7fbaf8123370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 0x7fbaf8128730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf8128d80 con 0x7fbaf8112b10 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf8128ef0 con 0x7fbaf8112fc0 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf81290b0 con 0x7fbaf810c4e0 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 0x7fbaf8128730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 0x7fbaf8128730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:45534/0 (socket says 10.20.193.126:45534) 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 -- 10.20.193.126:0/3651527620 learned_addr learned my addr 10.20.193.126:0/3651527620 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaeffff6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbaf8112b10 0x7fbaf8123370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 -- 10.20.193.126:0/3651527620 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf810c4e0 msgr2=0x7fbaf8122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafcdfd6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf810c4e0 0x7fbaf8122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:16.940 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf810c4e0 0x7fbaf8122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 -- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbaf8112b10 msgr2=0x7fbaf8123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbaf8112b10 0x7fbaf8123370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 -- 10.20.193.126:0/3651527620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae8009590 con 0x7fbaf8112fc0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafcdfd6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf810c4e0 0x7fbaf8122e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbafd5fe6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 0x7fbaf8128730 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaf4006ea0 tx=0x7fbaf400cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaf4003a30 con 0x7fbaf8112fc0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbaf40054f0 con 0x7fbaf8112fc0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf8129390 con 0x7fbaf8112fc0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbaf400dcd0 con 0x7fbaf8112fc0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.936+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf8169a70 con 0x7fbaf8112fc0 2026-02-13T01:24:16.941 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.937+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf8065120 con 0x7fbaf8112fc0 2026-02-13T01:24:16.942 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.938+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fbaf4005030 con 0x7fbaf8112fc0 2026-02-13T01:24:16.943 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.939+0000 7fbaedffb6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbad40b56d0 0x7fbad40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:16.943 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.939+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4661+0+0 (secure 0 0 0) 0x7fbaf40e3e00 con 0x7fbaf8112fc0 2026-02-13T01:24:16.943 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.939+0000 7fbafcdfd6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbad40b56d0 0x7fbad40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:16.943 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.939+0000 7fbafcdfd6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbad40b56d0 0x7fbad40d5b80 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbae80098c0 tx=0x7fbae8009230 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:16.943 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:16.939+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbaf40a75e0 con 0x7fbaf8112fc0 2026-02-13T01:24:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: pgmap v82: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 215 KiB/s, 0 objects/s recovering 2026-02-13T01:24:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:16.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:17.037 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:17.037+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fbaf8123fe0 con 0x7fbad40b56d0 2026-02-13T01:24:17.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: pgmap v83: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 182 KiB/s, 0 objects/s recovering 2026-02-13T01:24:17.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: pgmap v84: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 151 KiB/s, 0 objects/s recovering 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: pgmap v83: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 182 KiB/s, 0 objects/s recovering 2026-02-13T01:24:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: pgmap v84: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 151 KiB/s, 0 objects/s recovering 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: pgmap v83: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 182 KiB/s, 0 objects/s recovering 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: pgmap v84: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 151 KiB/s, 0 objects/s recovering 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:17.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:17.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:17.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:17.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:17.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:17.980 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:24:17 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:24:17.623+0000 7f20720d46c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T01:24:17.980 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:24:17 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:24:17.627+0000 7f206df986c0 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:18.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:18.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: pgmap v86: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:18.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:24:18.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/3495727471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"}]': finished 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] boot 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/3955471489' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:18 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: pgmap v86: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/3495727471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"}]': finished 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] boot 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/3955471489' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:18.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:18 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='client.24410 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: pgmap v86: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/3495727471' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"} : dispatch 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"} : dispatch 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ec7f6c4-8479-4e14-855e-fa3b594f058c"}]': finished 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: osd.6 [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] boot 2026-02-13T01:24:18.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: osdmap e41: 8 total, 7 up, 8 in 2026-02-13T01:24:18.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T01:24:18.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:18.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/3955471489' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:18.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:18.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:18 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:24:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:19 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:20.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:20.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:20.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:19 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:20.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:20.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:19 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.960 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:20 trial126 ceph-mon[26569]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:20.960 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:20 trial126 ceph-mon[26569]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:20.960 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:20 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:24:20.960 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:20 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:20.966 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:20 trial126 ceph-mon[26569]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:21.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:20 trial154 ceph-mon[27045]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:21.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:20 trial154 ceph-mon[27045]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:21.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:20 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:24:21.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:20 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:20 trial154 ceph-mon[27045]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:21.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:20 trial091 ceph-mon[25068]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:21.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:20 trial091 ceph-mon[25068]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:21.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:20 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T01:24:21.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:20 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:21.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:20 trial091 ceph-mon[25068]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:22.107 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:21 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:22.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:21 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:22.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:21 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:22 trial126 ceph-mon[26569]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:23.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:23.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:23.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:23.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:22 trial154 ceph-mon[27045]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:23.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:23.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:23.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:23.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:22 trial091 ceph-mon[25068]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:23.332 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 7 on host 'trial126' 2026-02-13T01:24:23.333 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.330+0000 7fbaedffb6c0 1 -- 10.20.193.126:0/3651527620 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fbaf8123fe0 con 0x7fbad40b56d0 2026-02-13T01:24:23.335 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbad40b56d0 msgr2=0x7fbad40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.335 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbad40b56d0 0x7fbad40d5b80 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbae80098c0 tx=0x7fbae8009230 comp rx=0 tx=0).stop 2026-02-13T01:24:23.335 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 msgr2=0x7fbaf8128730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 0x7fbaf8128730 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbaf4006ea0 tx=0x7fbaf400cca0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 shutdown_connections 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbad40b56d0 0x7fbad40d5b80 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbaf8112fc0 0x7fbaf8128730 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbaf8112b10 0x7fbaf8123370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 --2- 10.20.193.126:0/3651527620 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbaf810c4e0 0x7fbaf8122e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 >> 10.20.193.126:0/3651527620 conn(0x7fbaf8063af0 msgr2=0x7fbaf810e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 shutdown_connections 2026-02-13T01:24:23.336 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:23.333+0000 7fbaff08c6c0 1 -- 10.20.193.126:0/3651527620 wait complete. 2026-02-13T01:24:23.382 DEBUG:teuthology.orchestra.run.trial126:osd.7> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.7.service 2026-02-13T01:24:23.385 INFO:tasks.cephadm:Deploying osd.8 on trial154 with /dev/vg_nvme/lv_2... 2026-02-13T01:24:23.385 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T01:24:23.506 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:23.974 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:24:23.991 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_2 --skip-validation 2026-02-13T01:24:24.110 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:24.173 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.173 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.173 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:24.173 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:24.173 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.174 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:23 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:24.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:24.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:24.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:23 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- 10.20.193.154:0/1119754828 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe220060720 msgr2=0x7fe220060af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:24.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/1119754828 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe220060720 0x7fe220060af0 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=7131038896811401393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe210009970 tx=0x7fe21002ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:24.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- 10.20.193.154:0/1119754828 shutdown_connections 2026-02-13T01:24:24.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/1119754828 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe2201556e0 0x7fe220175ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:24.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/1119754828 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe220061030 0x7fe2201551a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/1119754828 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe220060720 0x7fe220060af0 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=7131038896811401393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- 10.20.193.154:0/1119754828 >> 10.20.193.154:0/1119754828 conn(0x7fe2200ea8b0 msgr2=0x7fe22010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- 10.20.193.154:0/1119754828 shutdown_connections 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- 10.20.193.154:0/1119754828 wait complete. 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 Processor -- start 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- start start 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe220060720 0x7fe2201615e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe220061030 0x7fe220161b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 0x7fe220166ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:24.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe220167530 con 0x7fe220060720 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe2201676a0 con 0x7fe220061030 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22811c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe220167860 con 0x7fe2201556e0 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 0x7fe220166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 0x7fe220166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:58500/0 (socket says 10.20.193.154:58500) 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 -- 10.20.193.154:0/2221208467 learned_addr learned my addr 10.20.193.154:0/2221208467 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22568c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe220061030 0x7fe220161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe225e8d6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe220060720 0x7fe2201615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 -- 10.20.193.154:0/2221208467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe220061030 msgr2=0x7fe220161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe220061030 0x7fe220161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:24.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 -- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe220060720 msgr2=0x7fe2201615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe220060720 0x7fe2201615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 -- 10.20.193.154:0/2221208467 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe210009590 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.240+0000 7fe22668e6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 0x7fe220166ee0 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c006ea0 tx=0x7fe21c00cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.241+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe21c003a30 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.241+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe220167b40 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.241+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe21c0054f0 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.241+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe21c00dcd0 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.241+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe220151310 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.241+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe220061c30 con 0x7fe2201556e0 2026-02-13T01:24:24.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.242+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fe21c005030 con 0x7fe2201556e0 2026-02-13T01:24:24.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.243+0000 7fe20effd6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1fc0b5650 0x7fe1fc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:24.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.243+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5093+0+0 (secure 0 0 0) 0x7fe21c0e3ff0 con 0x7fe2201556e0 2026-02-13T01:24:24.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.243+0000 7fe225e8d6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1fc0b5650 0x7fe1fc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:24.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.243+0000 7fe225e8d6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1fc0b5650 0x7fe1fc0d5b00 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2100098c0 tx=0x7fe210005c80 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:24.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.243+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe21c0a7620 con 0x7fe2201556e0 2026-02-13T01:24:24.268 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:24.269 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.270 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:23 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:24.342 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:24.341+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fe220167d30 con 0x7fe1fc0b5650 2026-02-13T01:24:25.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:25.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:25.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:25.218 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:24 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:25.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:25.230 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:24 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T01:24:25.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:25.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:25.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:24 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:25.351 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:24:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:24:24.925+0000 7fdcbcb216c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T01:24:25.351 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:24:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:24:24.930+0000 7fdcb89e56c0 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/2722644411' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"} : dispatch 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"} : dispatch 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"}]': finished 2026-02-13T01:24:26.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] boot 2026-02-13T01:24:26.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:24:26.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:26.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/3377737779' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:26.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:26.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:25 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/2722644411' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"} : dispatch 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"} : dispatch 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"}]': finished 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] boot 2026-02-13T01:24:26.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:24:26.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:26.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/3377737779' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:26.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:26.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:25 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:26.249 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/2722644411' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"} : dispatch 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"} : dispatch 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19fbc479-f0bf-46d3-9d48-648388632fb7"}]': finished 2026-02-13T01:24:26.250 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: osd.7 [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] boot 2026-02-13T01:24:26.251 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T01:24:26.251 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T01:24:26.251 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:26.251 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/3377737779' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:26.251 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:26.251 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:25 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:27.376 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:27.376 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:27.376 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:24:27.376 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:27.376 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:27.376 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.377 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:27.377 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:27.377 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:27.377 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:27.377 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:27 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:27.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:27.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:27 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:27.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:27 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:28.149 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.149 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.149 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.149 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:24:28.149 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:28.150 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:24:28.150 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:28 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:28.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.554 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.554 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.554 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:24:28.554 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:28.554 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:24:28.554 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:28 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: pgmap v102: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: pgmap v104: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T01:24:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T01:24:28.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:28 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:29.407 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:29 trial154 ceph-mon[27045]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:29.407 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:29 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:29.408 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:29 trial154 ceph-mon[27045]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:24:29.408 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:29 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:29.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:29 trial091 ceph-mon[25068]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:29.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:29 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:29.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:29 trial091 ceph-mon[25068]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:24:29.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:29 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:29 trial126 ceph-mon[26569]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:29 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:29 trial126 ceph-mon[26569]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T01:24:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:29 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:30.462 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:30 trial154 ceph-mon[27045]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:24:30.462 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:30 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:30.462 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:30 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:30.462 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:30 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:30.462 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:30 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:30.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:30 trial091 ceph-mon[25068]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:24:30.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:30 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:30.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:30 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:30.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:30 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:30.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:30 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:30.597 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.596+0000 7fe20effd6c0 1 -- 10.20.193.154:0/2221208467 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fe220167d30 con 0x7fe1fc0b5650 2026-02-13T01:24:30.598 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 8 on host 'trial154' 2026-02-13T01:24:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:30 trial126 ceph-mon[26569]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T01:24:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:30 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:30 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:30 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:30 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:30.600 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1fc0b5650 msgr2=0x7fe1fc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.600 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1fc0b5650 0x7fe1fc0d5b00 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2100098c0 tx=0x7fe210005c80 comp rx=0 tx=0).stop 2026-02-13T01:24:30.600 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 msgr2=0x7fe220166ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 0x7fe220166ee0 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe21c006ea0 tx=0x7fe21c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 shutdown_connections 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1fc0b5650 0x7fe1fc0d5b00 unknown :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe2201556e0 0x7fe220166ee0 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe220061030 0x7fe220161b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 --2- 10.20.193.154:0/2221208467 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe220060720 0x7fe2201615e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 >> 10.20.193.154:0/2221208467 conn(0x7fe2200ea8b0 msgr2=0x7fe22010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 shutdown_connections 2026-02-13T01:24:30.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:30.598+0000 7fe22811c6c0 1 -- 10.20.193.154:0/2221208467 wait complete. 2026-02-13T01:24:30.642 DEBUG:teuthology.orchestra.run.trial154:osd.8> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.8.service 2026-02-13T01:24:30.644 INFO:tasks.cephadm:Deploying osd.9 on trial091 with /dev/vg_nvme/lv_1... 2026-02-13T01:24:30.645 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:24:30.764 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:31.201 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:31.220 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial091:vg_nvme/lv_1 --skip-validation 2026-02-13T01:24:31.338 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:31.453 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:31.453 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.453 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.453 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.454 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.455 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:31 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:31.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 -- 10.20.193.91:0/3481585955 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 msgr2=0x7fbec8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:31.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/3481585955 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec8175db0 secure :-1 s=READY pgs=164 gs=1 cs=0 l=1 c_cookie=18147504892299100730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbec400aa70 tx=0x7fbec402fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 -- 10.20.193.91:0/3481585955 shutdown_connections 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/3481585955 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec8175db0 unknown :-1 s=CLOSED pgs=164 gs=1 cs=0 l=1 c_cookie=18147504892299100730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/3481585955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec810fbf0 0x7fbec8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/3481585955 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 0x7fbec810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 -- 10.20.193.91:0/3481585955 >> 10.20.193.91:0/3481585955 conn(0x7fbec80ecb00 msgr2=0x7fbec810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 -- 10.20.193.91:0/3481585955 shutdown_connections 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.455+0000 7fbeceae56c0 1 -- 10.20.193.91:0/3481585955 wait complete. 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 Processor -- start 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 -- start start 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 0x7fbec811d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec811d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:31.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec8122b00 0x7fbec8122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8123510 con 0x7fbec8115410 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8123680 con 0x7fbec8122b00 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8123840 con 0x7fbec810f200 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec811d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:39552/0 (socket says 10.20.193.91:39552) 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 -- 10.20.193.91:0/2598913900 learned_addr learned my addr 10.20.193.91:0/2598913900 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 -- 10.20.193.91:0/2598913900 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 msgr2=0x7fbec811d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbecc8566c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 0x7fbec811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 0x7fbec811d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 -- 10.20.193.91:0/2598913900 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec8122b00 msgr2=0x7fbec8122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:31.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbecd0576c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec8122b00 0x7fbec8122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec8122b00 0x7fbec8122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 -- 10.20.193.91:0/2598913900 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec400a660 con 0x7fbec8115410 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbecc8566c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 0x7fbec811d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbecd0576c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec8122b00 0x7fbec8122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebffff6c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec811d740 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb0005dc0 tx=0x7fbeb000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbeb0004250 con 0x7fbec8115410 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbeb0009070 con 0x7fbec8115410 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec8163cf0 con 0x7fbec8115410 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbeb000cd50 con 0x7fbec8115410 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.456+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec81641d0 con 0x7fbec8115410 2026-02-13T01:24:31.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.457+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec81104d0 con 0x7fbec8115410 2026-02-13T01:24:31.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.458+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fbeb00028c0 con 0x7fbec8115410 2026-02-13T01:24:31.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.459+0000 7fbebdffb6c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbea40b56d0 0x7fbea40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:31.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.459+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5525+0+0 (secure 0 0 0) 0x7fbeb00e3130 con 0x7fbec8115410 2026-02-13T01:24:31.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.459+0000 7fbecc8566c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbea40b56d0 0x7fbea40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:31.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.459+0000 7fbecc8566c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbea40b56d0 0x7fbea40d5b80 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb8004750 tx=0x7fbeb8006e70 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:31.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.459+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbeb00a6570 con 0x7fbec8115410 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:31.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:31.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:31.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:31.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.467 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:31 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:31.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:31.555+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fbec811e3c0 con 0x7fbea40b56d0 2026-02-13T01:24:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:31 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.459 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.460 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.461 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.461 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:32 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:24:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:32 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:32.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:32 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:32.718 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:24:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:24:32.216+0000 7f72905616c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T01:24:32.718 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:24:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:24:32.221+0000 7f728841d6c0 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2162485' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3befdc3-c847-4659-9ec1-0dd5e3172fe7"} : dispatch 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2162485' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3befdc3-c847-4659-9ec1-0dd5e3172fe7"}]': finished 2026-02-13T01:24:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] boot 2026-02-13T01:24:33.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T01:24:33.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:33.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3190243181' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:33.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:33.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:33 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T01:24:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2162485' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3befdc3-c847-4659-9ec1-0dd5e3172fe7"} : dispatch 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2162485' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3befdc3-c847-4659-9ec1-0dd5e3172fe7"}]': finished 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] boot 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3190243181' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:33 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:33.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial091:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:33.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2162485' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a3befdc3-c847-4659-9ec1-0dd5e3172fe7"} : dispatch 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2162485' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a3befdc3-c847-4659-9ec1-0dd5e3172fe7"}]': finished 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: osd.8 [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] boot 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3190243181' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:33.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:33.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:33 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:34.589 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:34.589 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:34.590 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:34 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:34.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:34.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:34.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:34 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:34.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:34.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:34.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:34 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:35.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:24:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:24:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:35 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:35.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:24:35.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:35.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:24:35.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:35 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:35.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:35.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T01:24:35.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:35.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T01:24:35.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:35 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:36.671 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:36 trial091 ceph-mon[25068]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:36.671 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:36 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:36.671 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:36 trial091 ceph-mon[25068]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:24:36.671 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:36 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:36.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:36 trial154 ceph-mon[27045]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:36.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:36 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:36.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:36 trial154 ceph-mon[27045]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:24:36.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:36 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:36 trial126 ceph-mon[26569]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T01:24:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:36 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:36 trial126 ceph-mon[26569]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T01:24:36.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:36 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:37 trial091 ceph-mon[25068]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:24:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:37 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:37 trial091 ceph-mon[25068]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:24:37.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:37 trial154 ceph-mon[27045]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:24:37.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:37 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:37.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:37 trial154 ceph-mon[27045]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:24:37.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.970+0000 7fbebdffb6c0 1 -- 10.20.193.91:0/2598913900 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fbec811e3c0 con 0x7fbea40b56d0 2026-02-13T01:24:37.970 INFO:teuthology.orchestra.run.trial091.stdout:Created osd(s) 9 on host 'trial091' 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbea40b56d0 msgr2=0x7fbea40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbea40b56d0 0x7fbea40d5b80 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb8004750 tx=0x7fbeb8006e70 comp rx=0 tx=0).stop 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 msgr2=0x7fbec811d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec811d740 secure :-1 s=READY pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbeb0005dc0 tx=0x7fbeb000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 shutdown_connections 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbea40b56d0 0x7fbea40d5b80 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbec8122b00 0x7fbec8122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbec8115410 0x7fbec811d740 unknown :-1 s=CLOSED pgs=165 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 --2- 10.20.193.91:0/2598913900 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbec810f200 0x7fbec811d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:37.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 >> 10.20.193.91:0/2598913900 conn(0x7fbec80ecb00 msgr2=0x7fbec810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:37.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 shutdown_connections 2026-02-13T01:24:37.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:37.973+0000 7fbeceae56c0 1 -- 10.20.193.91:0/2598913900 wait complete. 2026-02-13T01:24:38.033 DEBUG:teuthology.orchestra.run.trial091:osd.9> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.9.service 2026-02-13T01:24:38.035 INFO:tasks.cephadm:Deploying osd.10 on trial126 with /dev/vg_nvme/lv_1... 2026-02-13T01:24:38.035 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:24:38.060 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:37 trial126 ceph-mon[26569]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T01:24:38.060 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:38.060 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:38.061 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.061 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:37 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.061 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:37 trial126 ceph-mon[26569]: pgmap v124: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.159 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:24:38.616 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-13T01:24:38.633 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_1 --skip-validation 2026-02-13T01:24:38.791 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.b/config 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:38.838 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.839 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:38 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:38.915 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/3247037113 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810ba90 msgr2=0x7f0bc810be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:38.915 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/3247037113 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810ba90 0x7f0bc810be60 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=4670096924789901512 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bb8009970 tx=0x7f0bb802ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:38.915 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/3247037113 shutdown_connections 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/3247037113 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc81557c0 0x7f0bc8175ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/3247037113 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8155280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/3247037113 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810ba90 0x7f0bc810be60 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=4670096924789901512 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/3247037113 >> 10.20.193.126:0/3247037113 conn(0x7f0bc80e9770 msgr2=0x7f0bc8109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/3247037113 shutdown_connections 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.912+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/3247037113 wait complete. 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 Processor -- start 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 -- start start 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc810ba90 0x7f0bc8160640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8160b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:38.916 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc81557c0 0x7f0bc8165f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc8166590 con 0x7f0bc810ba90 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc8166700 con 0x7f0bc810c3a0 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc81668c0 con 0x7f0bc81557c0 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8160b80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:33722/0 (socket says 10.20.193.126:33722) 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 -- 10.20.193.126:0/1461962953 learned_addr learned my addr 10.20.193.126:0/1461962953 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcd8466c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc81557c0 0x7f0bc8165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcd0456c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc810ba90 0x7f0bc8160640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 -- 10.20.193.126:0/1461962953 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc81557c0 msgr2=0x7f0bc8165f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc81557c0 0x7f0bc8165f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.917 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 -- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc810ba90 msgr2=0x7f0bc8160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc810ba90 0x7f0bc8160640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 -- 10.20.193.126:0/1461962953 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb8009590 con 0x7f0bc810c3a0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcd8466c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc81557c0 0x7f0bc8165f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcd0456c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc810ba90 0x7f0bc8160640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcc8446c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8160b80 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bbc005dc0 tx=0x7f0bbc00bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0bbc004250 con 0x7f0bc810c3a0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0bbc009070 con 0x7f0bc810c3a0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc8166ba0 con 0x7f0bc810c3a0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0bbc00cd70 con 0x7f0bc810c3a0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.913+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc8152400 con 0x7f0bc810c3a0 2026-02-13T01:24:38.918 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.914+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc8166dc0 con 0x7f0bc810c3a0 2026-02-13T01:24:38.919 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.915+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0bbc0028c0 con 0x7f0bc810c3a0 2026-02-13T01:24:38.920 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.915+0000 7f0bb67fc6c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ba40b5650 0x7f0ba40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:38.920 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.916+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5957+0+0 (secure 0 0 0) 0x7f0bbc0e3330 con 0x7f0bc810c3a0 2026-02-13T01:24:38.920 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.916+0000 7f0bcd0456c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ba40b5650 0x7f0ba40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:38.920 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.916+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0bbc0a65c0 con 0x7f0bc810c3a0 2026-02-13T01:24:38.920 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:38.916+0000 7f0bcd0456c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ba40b5650 0x7f0ba40d5b00 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bb80098c0 tx=0x7f0bb8009230 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:38.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:38 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T01:24:38.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:38 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:39.012 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:39.011+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f0bc8161790 con 0x7f0ba40b5650 2026-02-13T01:24:39.917 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.918 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.919 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.920 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:39 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:24:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:39 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial091", "root=default"]} : dispatch 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='client.24479 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:39.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T01:24:39.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:39.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:39.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:39 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:39.980 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:24:39 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:24:39.623+0000 7fac133356c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T01:24:39.980 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:24:39 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:24:39.630+0000 7fac0b1f16c0 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:40.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:24:40.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T01:24:40.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/3172644829' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"}]': finished 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] boot 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: from='client.? 10.20.193.126:0/3484173625' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:40.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:40 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/3172644829' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"} : dispatch 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"} : dispatch 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"}]': finished 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] boot 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:24:40.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:40.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:40.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: from='client.? 10.20.193.126:0/3484173625' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:40.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:40.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:40 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:41.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial091", "root=default"]}]': finished 2026-02-13T01:24:41.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T01:24:41.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:41.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:41.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/3172644829' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"} : dispatch 2026-02-13T01:24:41.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"} : dispatch 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36fe781f-9334-474b-bc6b-01e798e72a81"}]': finished 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: osd.9 [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] boot 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: osdmap e59: 11 total, 10 up, 11 in 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: from='client.? 10.20.193.126:0/3484173625' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:41.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:40 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:42.090 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.091 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:42.092 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:42.092 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:41 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:42.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:42.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:42.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:41 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:42.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:42.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:42.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:42.229 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:41 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.917 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:42 trial126 ceph-mon[26569]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:42.917 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:42 trial126 ceph-mon[26569]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:42.917 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:42 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:24:42.917 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:42 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:42.917 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:42 trial126 ceph-mon[26569]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:43.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:42 trial091 ceph-mon[25068]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:43.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:42 trial091 ceph-mon[25068]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:43.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:42 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:24:43.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:42 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:43.129 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:42 trial091 ceph-mon[25068]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:43.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:42 trial154 ceph-mon[27045]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:43.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:42 trial154 ceph-mon[27045]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:43.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:42 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T01:24:43.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:42 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:43.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:42 trial154 ceph-mon[27045]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:44.079 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:43 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:44.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:43 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:44.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:43 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:45.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:44 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:45.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:44 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:45.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:44 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:45.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:44 trial126 ceph-mon[26569]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:45.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:44 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:45.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:44 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:45.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:44 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:45.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:44 trial154 ceph-mon[27045]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:45.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:44 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:45.227 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:44 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:45.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:44 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:45.228 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:44 trial091 ceph-mon[25068]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:45.386 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 10 on host 'trial126' 2026-02-13T01:24:45.386 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.385+0000 7f0bb67fc6c0 1 -- 10.20.193.126:0/1461962953 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0bc8161790 con 0x7f0ba40b5650 2026-02-13T01:24:45.389 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.387+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ba40b5650 msgr2=0x7f0ba40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.389 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.387+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ba40b5650 0x7f0ba40d5b00 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bb80098c0 tx=0x7f0bb8009230 comp rx=0 tx=0).stop 2026-02-13T01:24:45.389 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.387+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 msgr2=0x7f0bc8160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:45.389 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.387+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8160b80 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0bbc005dc0 tx=0x7f0bbc00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.389 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 shutdown_connections 2026-02-13T01:24:45.389 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ba40b5650 0x7f0ba40d5b00 unknown :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.390 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0bc81557c0 0x7f0bc8165f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.390 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bc810c3a0 0x7f0bc8160b80 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.390 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 --2- 10.20.193.126:0/1461962953 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0bc810ba90 0x7f0bc8160640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:45.390 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 >> 10.20.193.126:0/1461962953 conn(0x7f0bc80e9770 msgr2=0x7f0bc8109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:45.390 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 shutdown_connections 2026-02-13T01:24:45.390 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-13T01:24:45.388+0000 7f0bcf2d46c0 1 -- 10.20.193.126:0/1461962953 wait complete. 2026-02-13T01:24:45.433 DEBUG:teuthology.orchestra.run.trial126:osd.10> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.10.service 2026-02-13T01:24:45.436 INFO:tasks.cephadm:Deploying osd.11 on trial154 with /dev/vg_nvme/lv_1... 2026-02-13T01:24:45.436 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T01:24:45.556 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:46.000 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-13T01:24:46.017 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch daemon add osd trial154:vg_nvme/lv_1 --skip-validation 2026-02-13T01:24:46.137 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:46.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.215 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:46.216 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.217 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:45 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/1621517059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 msgr2=0x7fd5b4175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/1621517059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b4175de0 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=13803981447375059320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5a800aa70 tx=0x7fd5a802fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/1621517059 shutdown_connections 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/1621517059 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b4175de0 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=13803981447375059320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/1621517059 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd5b410fc20 0x7fd5b4114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/1621517059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5b410f230 0x7fd5b410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/1621517059 >> 10.20.193.154:0/1621517059 conn(0x7fd5b40ecb30 msgr2=0x7fd5b410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/1621517059 shutdown_connections 2026-02-13T01:24:46.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/1621517059 wait complete. 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 Processor -- start 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- start start 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd5b410f230 0x7fd5b411d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b411d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5b4122b00 0x7fd5b4122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4123510 con 0x7fd5b410f230 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4123680 con 0x7fd5b4122b00 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.257+0000 7fd5ba4986c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4123840 con 0x7fd5b4115440 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b411d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:51384/0 (socket says 10.20.193.154:51384) 2026-02-13T01:24:46.262 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 -- 10.20.193.154:0/3314902446 learned_addr learned my addr 10.20.193.154:0/3314902446 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b3fff6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd5b410f230 0x7fd5b411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b8a0e6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5b4122b00 0x7fd5b4122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 -- 10.20.193.154:0/3314902446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5b4122b00 msgr2=0x7fd5b4122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5b4122b00 0x7fd5b4122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 -- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd5b410f230 msgr2=0x7fd5b411d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd5b410f230 0x7fd5b411d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 -- 10.20.193.154:0/3314902446 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a800a660 con 0x7fd5b4115440 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b37fe6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b411d740 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5a4005dc0 tx=0x7fd5a400bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5a4004250 con 0x7fd5b4115440 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd5a4009070 con 0x7fd5b4115440 2026-02-13T01:24:46.263 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b4163cf0 con 0x7fd5b4115440 2026-02-13T01:24:46.264 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5a400cd50 con 0x7fd5b4115440 2026-02-13T01:24:46.264 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b41641d0 con 0x7fd5b4115440 2026-02-13T01:24:46.264 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.258+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b4110500 con 0x7fd5b4115440 2026-02-13T01:24:46.265 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.260+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fd5a40028c0 con 0x7fd5b4115440 2026-02-13T01:24:46.265 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.260+0000 7fd5b17fa6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd5880b56d0 0x7fd5880d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:46.265 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.260+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6390+0+0 (secure 0 0 0) 0x7fd5a40e33e0 con 0x7fd5b4115440 2026-02-13T01:24:46.265 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.260+0000 7fd5b3fff6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd5880b56d0 0x7fd5880d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:46.265 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.261+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd5a40a64c0 con 0x7fd5b4115440 2026-02-13T01:24:46.265 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.261+0000 7fd5b3fff6c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd5880b56d0 0x7fd5880d5b80 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5a0004750 tx=0x7fd5a0009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:46.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:45 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:46.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:46.359+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd5b410fc20 con 0x7fd5880b56d0 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:46.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:24:46.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T01:24:46.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:46.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:46.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:46.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:46 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:47.270 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.271 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.272 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:47 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:24:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:24:47.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:47 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.351 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:24:47 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:24:47.010+0000 7f261ff3d6c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T01:24:47.351 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:24:47 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:24:47.016+0000 7f2617df96c0 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T01:24:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T01:24:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]} : dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial154:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:47.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:47 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T01:24:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/3205490826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"} : dispatch 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"} : dispatch 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"}]': finished 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] boot 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: from='client.? 10.20.193.154:0/1165419174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:48.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:48 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:48.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:48.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:48.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/3205490826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"}]': finished 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] boot 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: from='client.? 10.20.193.154:0/1165419174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:48.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:48 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/3205490826' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"} : dispatch 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"} : dispatch 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f569e12-4d88-4cf0-8f2e-147ace91f917"}]': finished 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: osd.10 [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] boot 2026-02-13T01:24:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T01:24:48.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T01:24:48.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:48.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.154:0/1165419174' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T01:24:48.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:48.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:48 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.426 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:49.427 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:49.427 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:49 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:49.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:49.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:49 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T01:24:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:49 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:24:50.298 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:50 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:50.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:24:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:24:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:50 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T01:24:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:50 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:51.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:51 trial154 ceph-mon[27045]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:51.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:51 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:51.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:51 trial154 ceph-mon[27045]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:24:51.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:51 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:51.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:51 trial091 ceph-mon[25068]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:51.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:51 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:51.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:51 trial091 ceph-mon[25068]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:24:51.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:51 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:51 trial126 ceph-mon[26569]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:51 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:51 trial126 ceph-mon[26569]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T01:24:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:51 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:52.241 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:52 trial154 ceph-mon[27045]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:24:52.241 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:52.241 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:52.241 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:52.241 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:52 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:52.477 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:52 trial091 ceph-mon[25068]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:24:52.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:52.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:52.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:52.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:52 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:52 trial126 ceph-mon[26569]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T01:24:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:52 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:52.812 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.811+0000 7fd5b17fa6c0 1 -- 10.20.193.154:0/3314902446 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd5b410fc20 con 0x7fd5880b56d0 2026-02-13T01:24:52.813 INFO:teuthology.orchestra.run.trial154.stdout:Created osd(s) 11 on host 'trial154' 2026-02-13T01:24:52.815 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd5880b56d0 msgr2=0x7fd5880d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd5880b56d0 0x7fd5880d5b80 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5a0004750 tx=0x7fd5a0009260 comp rx=0 tx=0).stop 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 msgr2=0x7fd5b411d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b411d740 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5a4005dc0 tx=0x7fd5a400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 shutdown_connections 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd5880b56d0 0x7fd5880d5b80 unknown :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5b4122b00 0x7fd5b4122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd5b4115440 0x7fd5b411d740 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 --2- 10.20.193.154:0/3314902446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd5b410f230 0x7fd5b411d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 >> 10.20.193.154:0/3314902446 conn(0x7fd5b40ecb30 msgr2=0x7fd5b410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 shutdown_connections 2026-02-13T01:24:52.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:52.813+0000 7fd5ba4986c0 1 -- 10.20.193.154:0/3314902446 wait complete. 2026-02-13T01:24:52.855 DEBUG:teuthology.orchestra.run.trial154:osd.11> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.11.service 2026-02-13T01:24:52.858 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T01:24:52.858 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:24:52.982 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1572676293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810fc20 msgr2=0x7f0e68114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1572676293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810fc20 0x7f0e68114c60 secure :-1 s=READY pgs=173 gs=1 cs=0 l=1 c_cookie=4166887437370587669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e500099a0 tx=0x7f0e5002ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1572676293 shutdown_connections 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1572676293 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e68115440 0x7f0e68175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1572676293 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810fc20 0x7f0e68114c60 unknown :-1 s=CLOSED pgs=173 gs=1 cs=0 l=1 c_cookie=4166887437370587669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1572676293 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0e6810f230 0x7f0e6810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1572676293 >> 10.20.193.91:0/1572676293 conn(0x7f0e680ecb30 msgr2=0x7f0e6810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1572676293 shutdown_connections 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.102+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1572676293 wait complete. 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 Processor -- start 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 -- start start 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 0x7f0e680f4d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e68115440 0x7f0e68175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0e680f5370 0x7f0e680fa640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0e680f5a60 con 0x7f0e6810f230 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0e680fab80 con 0x7f0e68115440 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e680fad40 con 0x7f0e680f5370 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 0x7f0e680f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:53.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 0x7f0e680f4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:57184/0 (socket says 10.20.193.91:57184) 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 -- 10.20.193.91:0/1651623103 learned_addr learned my addr 10.20.193.91:0/1651623103 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e677fe6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0e680f5370 0x7f0e680fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e667fc6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e68115440 0x7f0e68175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 -- 10.20.193.91:0/1651623103 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0e680f5370 msgr2=0x7f0e680fa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0e680f5370 0x7f0e680fa640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 -- 10.20.193.91:0/1651623103 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e68115440 msgr2=0x7f0e68175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e68115440 0x7f0e68175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 -- 10.20.193.91:0/1651623103 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e50009590 con 0x7f0e6810f230 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e66ffd6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 0x7f0e680f4d40 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e5c00b6c0 tx=0x7f0e5c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e5c0044a0 con 0x7f0e6810f230 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0e5c00be50 con 0x7f0e6810f230 2026-02-13T01:24:53.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e680fb020 con 0x7f0e6810f230 2026-02-13T01:24:53.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0e5c00cd00 con 0x7f0e6810f230 2026-02-13T01:24:53.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.103+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e680fb4b0 con 0x7f0e6810f230 2026-02-13T01:24:53.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.104+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e68110500 con 0x7f0e6810f230 2026-02-13T01:24:53.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.105+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0e5c0026b0 con 0x7f0e6810f230 2026-02-13T01:24:53.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.106+0000 7f0e47fff6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0e3c0b5650 0x7f0e3c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:53.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.106+0000 7f0e667fc6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0e3c0b5650 0x7f0e3c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:53.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.106+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6801+0+0 (secure 0 0 0) 0x7f0e5c0e32e0 con 0x7f0e6810f230 2026-02-13T01:24:53.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.106+0000 7f0e667fc6c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0e3c0b5650 0x7f0e3c0d5b00 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e50005b40 tx=0x7f0e50005c20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:53.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.107+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0e5c0a62f0 con 0x7f0e6810f230 2026-02-13T01:24:53.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.201+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0e680fb4b0 con 0x7f0e6810f230 2026-02-13T01:24:53.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.202+0000 7f0e47fff6c0 1 -- 10.20.193.91:0/1651623103 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f0e680fb4b0 con 0x7f0e6810f230 2026-02-13T01:24:53.202 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0e3c0b5650 msgr2=0x7f0e3c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0e3c0b5650 0x7f0e3c0d5b00 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e50005b40 tx=0x7f0e50005c20 comp rx=0 tx=0).stop 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 msgr2=0x7f0e680f4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 0x7f0e680f4d40 secure :-1 s=READY pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0e5c00b6c0 tx=0x7f0e5c00bb90 comp rx=0 tx=0).stop 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 shutdown_connections 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0e3c0b5650 0x7f0e3c0d5b00 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0e680f5370 0x7f0e680fa640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e68115440 0x7f0e68175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 --2- 10.20.193.91:0/1651623103 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0e6810f230 0x7f0e680f4d40 unknown :-1 s=CLOSED pgs=174 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:53.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 >> 10.20.193.91:0/1651623103 conn(0x7f0e680ecb30 msgr2=0x7f0e68113e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:53.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 shutdown_connections 2026-02-13T01:24:53.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:53.203+0000 7f0e6d6146c0 1 -- 10.20.193.91:0/1651623103 wait complete. 2026-02-13T01:24:53.263 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1770945887,"num_in_osds":12,"osd_in_since":1770945887,"num_remapped_pgs":0} 2026-02-13T01:24:53.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:53.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:53.480 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:53 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1651623103' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:53.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:53.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:53.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:53 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1651623103' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: pgmap v152: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:53.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:53 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1651623103' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:54.264 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:24:54.383 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:54.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1020826480 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac115410 msgr2=0x7fecac175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1020826480 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac115410 0x7fecac175db0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=14216356458847921473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca000aa70 tx=0x7feca002fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1020826480 shutdown_connections 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1020826480 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac115410 0x7fecac175db0 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=14216356458847921473 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1020826480 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fecac10fbf0 0x7fecac114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1020826480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fecac10f200 0x7fecac10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1020826480 >> 10.20.193.91:0/1020826480 conn(0x7fecac0ecb00 msgr2=0x7fecac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1020826480 shutdown_connections 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1020826480 wait complete. 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.495+0000 7fecb258d6c0 1 Processor -- start 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- start start 2026-02-13T01:24:54.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fecac10f200 0x7fecac11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fecac115410 0x7fecac11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 0x7fecac122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fecac123560 con 0x7fecac122b50 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fecac1236d0 con 0x7fecac115410 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fecac123890 con 0x7fecac10f200 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 0x7fecac122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 0x7fecac122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:57214/0 (socket says 10.20.193.91:57214) 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 -- 10.20.193.91:0/1604486251 learned_addr learned my addr 10.20.193.91:0/1604486251 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecabfff6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fecac10f200 0x7fecac11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecab7fe6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fecac115410 0x7fecac11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:54.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 -- 10.20.193.91:0/1604486251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fecac10f200 msgr2=0x7fecac11d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fecac10f200 0x7fecac11d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 -- 10.20.193.91:0/1604486251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fecac115410 msgr2=0x7fecac11d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fecac115410 0x7fecac11d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 -- 10.20.193.91:0/1604486251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca000a660 con 0x7fecac122b50 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb0aff6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 0x7fecac122ff0 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca00054b0 tx=0x7feca00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca0003a30 con 0x7fecac122b50 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7feca0003b90 con 0x7fecac122b50 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecac163ce0 con 0x7fecac122b50 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feca00382f0 con 0x7fecac122b50 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecac164110 con 0x7fecac122b50 2026-02-13T01:24:54.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.496+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecac1104d0 con 0x7fecac122b50 2026-02-13T01:24:54.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.498+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7feca0008260 con 0x7fecac122b50 2026-02-13T01:24:54.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.498+0000 7feca97fa6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fec800b5650 0x7fec800d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:54.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.498+0000 7fecabfff6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fec800b5650 0x7fec800d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:54.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.498+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6839+0+0 (secure 0 0 0) 0x7feca0108a90 con 0x7fecac122b50 2026-02-13T01:24:54.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.499+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feca00cb9b0 con 0x7fecac122b50 2026-02-13T01:24:54.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.499+0000 7fecabfff6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fec800b5650 0x7fec800d5b00 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec98005980 tx=0x7fec98005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:54.535 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.536 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:54 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:54.537 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:24:54 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:24:54.418+0000 7feeb8dd56c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T01:24:54.537 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:24:54 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:24:54.425+0000 7feeb4c996c0 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T01:24:54.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.591+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fecac11e3a0 con 0x7fecac122b50 2026-02-13T01:24:54.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.591+0000 7feca97fa6c0 1 -- 10.20.193.91:0/1604486251 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7feca00ceb60 con 0x7fecac122b50 2026-02-13T01:24:54.592 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:54.592 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:54.592 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:54.594 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:54 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:54.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fec800b5650 msgr2=0x7fec800d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:54.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fec800b5650 0x7fec800d5b00 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec98005980 tx=0x7fec98005910 comp rx=0 tx=0).stop 2026-02-13T01:24:54.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 msgr2=0x7fecac122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:54.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 0x7fecac122ff0 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feca00054b0 tx=0x7feca00054e0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 shutdown_connections 2026-02-13T01:24:54.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fec800b5650 0x7fec800d5b00 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fecac122b50 0x7fecac122ff0 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fecac115410 0x7fecac11d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 --2- 10.20.193.91:0/1604486251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fecac10f200 0x7fecac11d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:54.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 >> 10.20.193.91:0/1604486251 conn(0x7fecac0ecb00 msgr2=0x7fecac10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:54.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 shutdown_connections 2026-02-13T01:24:54.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:54.593+0000 7fecb258d6c0 1 -- 10.20.193.91:0/1604486251 wait complete. 2026-02-13T01:24:54.634 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1770945887,"num_in_osds":12,"osd_in_since":1770945887,"num_remapped_pgs":0} 2026-02-13T01:24:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 147 KiB/s, 0 objects/s recovering 2026-02-13T01:24:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T01:24:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T01:24:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:54.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:54.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:54.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:54.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:54 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:55.635 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T01:24:55.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:55 trial154 ceph-mon[27045]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 152 KiB/s, 0 objects/s recovering 2026-02-13T01:24:55.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:55 trial154 ceph-mon[27045]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:55.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:55 trial154 ceph-mon[27045]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T01:24:55.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:55.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:55 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:55.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:55 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1604486251' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:55.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:55 trial091 ceph-mon[25068]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 152 KiB/s, 0 objects/s recovering 2026-02-13T01:24:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:55 trial091 ceph-mon[25068]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:55 trial091 ceph-mon[25068]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T01:24:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:55 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:55 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1604486251' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:55.755 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:55 trial126 ceph-mon[26569]: pgmap v155: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 152 KiB/s, 0 objects/s recovering 2026-02-13T01:24:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:55 trial126 ceph-mon[26569]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial154", "root=default"]}]': finished 2026-02-13T01:24:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:55 trial126 ceph-mon[26569]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T01:24:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:55 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:55 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1604486251' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- 10.20.193.91:0/834563846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c10fc20 msgr2=0x7fd75c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/834563846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c10fc20 0x7fd75c114c60 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=6899667339726043833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7500098d0 tx=0x7fd75002ec40 comp rx=0 tx=0).stop 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- 10.20.193.91:0/834563846 shutdown_connections 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/834563846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c115440 0x7fd75c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/834563846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c10fc20 0x7fd75c114c60 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=6899667339726043833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/834563846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd75c10f230 0x7fd75c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- 10.20.193.91:0/834563846 >> 10.20.193.91:0/834563846 conn(0x7fd75c0ecb30 msgr2=0x7fd75c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- 10.20.193.91:0/834563846 shutdown_connections 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- 10.20.193.91:0/834563846 wait complete. 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 Processor -- start 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- start start 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c10f230 0x7fd75c0f4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 0x7fd75c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd75c0f5290 0x7fd75c0fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0f5980 con 0x7fd75c115440 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0faaa0 con 0x7fd75c10f230 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7641f76c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c0fac60 con 0x7fd75c0f5290 2026-02-13T01:24:55.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 0x7fd75c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 0x7fd75c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:57232/0 (socket says 10.20.193.91:57232) 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 -- 10.20.193.91:0/2514019560 learned_addr learned my addr 10.20.193.91:0/2514019560 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd761f686c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c10f230 0x7fd75c0f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7627696c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd75c0f5290 0x7fd75c0fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 -- 10.20.193.91:0/2514019560 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd75c0f5290 msgr2=0x7fd75c0fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd75c0f5290 0x7fd75c0fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 -- 10.20.193.91:0/2514019560 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c10f230 msgr2=0x7fd75c0f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c10f230 0x7fd75c0f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.870+0000 7fd7617676c0 1 -- 10.20.193.91:0/2514019560 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7500094c0 con 0x7fd75c115440 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd761f686c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c10f230 0x7fd75c0f4c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd7617676c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 0x7fd75c175ce0 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7500023a0 tx=0x7fd75002fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:55.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd750002ae0 con 0x7fd75c115440 2026-02-13T01:24:55.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd750002c40 con 0x7fd75c115440 2026-02-13T01:24:55.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c0faee0 con 0x7fd75c115440 2026-02-13T01:24:55.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd750031030 con 0x7fd75c115440 2026-02-13T01:24:55.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c0fb360 con 0x7fd75c115440 2026-02-13T01:24:55.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.871+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75c110500 con 0x7fd75c115440 2026-02-13T01:24:55.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.872+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fd7500071c0 con 0x7fd75c115440 2026-02-13T01:24:55.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.873+0000 7fd74affd6c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7380b5650 0x7fd7380d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:55.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.873+0000 7fd761f686c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7380b5650 0x7fd7380d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:55.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.873+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7fd7501079b0 con 0x7fd75c115440 2026-02-13T01:24:55.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.873+0000 7fd761f686c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7380b5650 0x7fd7380d5b00 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd74c004750 tx=0x7fd74c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:55.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.874+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7500ca7c0 con 0x7fd75c115440 2026-02-13T01:24:55.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.964+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd75c0f5db0 con 0x7fd75c115440 2026-02-13T01:24:55.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.965+0000 7fd74affd6c0 1 -- 10.20.193.91:0/2514019560 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fd7500cd970 con 0x7fd75c115440 2026-02-13T01:24:55.965 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:55.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7380b5650 msgr2=0x7fd7380d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7380b5650 0x7fd7380d5b00 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd74c004750 tx=0x7fd74c009260 comp rx=0 tx=0).stop 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 msgr2=0x7fd75c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 0x7fd75c175ce0 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7500023a0 tx=0x7fd75002fb20 comp rx=0 tx=0).stop 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 shutdown_connections 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd7380b5650 0x7fd7380d5b00 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd75c0f5290 0x7fd75c0fa560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd75c115440 0x7fd75c175ce0 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 --2- 10.20.193.91:0/2514019560 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd75c10f230 0x7fd75c0f4c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 >> 10.20.193.91:0/2514019560 conn(0x7fd75c0ecb30 msgr2=0x7fd75c10d930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 shutdown_connections 2026-02-13T01:24:55.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:55.966+0000 7fd7641f76c0 1 -- 10.20.193.91:0/2514019560 wait complete. 2026-02-13T01:24:56.007 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1770945895,"num_in_osds":12,"osd_in_since":1770945887,"num_remapped_pgs":0} 2026-02-13T01:24:56.008 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:24:56.124 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- 10.20.193.91:0/1489609661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb360115410 msgr2=0x7fb360175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/1489609661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb360115410 0x7fb360175db0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=8676751394715665658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35c00aa70 tx=0x7fb35c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- 10.20.193.91:0/1489609661 shutdown_connections 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/1489609661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb360115410 0x7fb360175db0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=8676751394715665658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/1489609661 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb36010fbf0 0x7fb360114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/1489609661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb36010f200 0x7fb36010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- 10.20.193.91:0/1489609661 >> 10.20.193.91:0/1489609661 conn(0x7fb3600ecb00 msgr2=0x7fb36010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- 10.20.193.91:0/1489609661 shutdown_connections 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- 10.20.193.91:0/1489609661 wait complete. 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 Processor -- start 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- start start 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 0x7fb36011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360115410 0x7fb36011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb360122b50 0x7fb360122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb360123560 con 0x7fb36010f200 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601236d0 con 0x7fb360115410 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.235+0000 7fb3684a46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb360123890 con 0x7fb360122b50 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 0x7fb36011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 0x7fb36011d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:57262/0 (socket says 10.20.193.91:57262) 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 -- 10.20.193.91:0/2767432122 learned_addr learned my addr 10.20.193.91:0/2767432122 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb365a146c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360115410 0x7fb36011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 -- 10.20.193.91:0/2767432122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb360122b50 msgr2=0x7fb360122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb360122b50 0x7fb360122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 -- 10.20.193.91:0/2767432122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360115410 msgr2=0x7fb36011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360115410 0x7fb36011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 -- 10.20.193.91:0/2767432122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c00a660 con 0x7fb36010f200 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3662156c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 0x7fb36011d250 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35000b710 tx=0x7fb35000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb350004250 con 0x7fb36010f200 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb360163d40 con 0x7fb36010f200 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb350002d80 con 0x7fb36010f200 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb35000cdc0 con 0x7fb36010f200 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601641d0 con 0x7fb36010f200 2026-02-13T01:24:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.236+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3601104d0 con 0x7fb36010f200 2026-02-13T01:24:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.238+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb3500028c0 con 0x7fb36010f200 2026-02-13T01:24:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.239+0000 7fb3477fe6c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb33c0b5650 0x7fb33c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.239+0000 7fb365a146c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb33c0b5650 0x7fb33c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.239+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7fb3500e38c0 con 0x7fb36010f200 2026-02-13T01:24:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.239+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3500a98c0 con 0x7fb36010f200 2026-02-13T01:24:56.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.239+0000 7fb365a146c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb33c0b5650 0x7fb33c0d5b00 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb354005980 tx=0x7fb354005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:56.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.332+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb36010fbf0 con 0x7fb36010f200 2026-02-13T01:24:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.332+0000 7fb3477fe6c0 1 -- 10.20.193.91:0/2767432122 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18492 (secure 0 0 0) 0x7fb3500a9aa0 con 0x7fb36010f200 2026-02-13T01:24:56.333 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:56.334 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":70,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","created":"2026-02-13T01:22:42.667442+0000","modified":"2026-02-13T01:24:55.419630+0000","last_up_change":"2026-02-13T01:24:55.419630+0000","last_in_change":"2026-02-13T01:24:47.172971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:51.498651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1ffbd7ff-7a87-4947-8ce2-ad23813a7754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6803","nonce":170892896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6805","nonce":170892896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6809","nonce":170892896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6807","nonce":170892896}]},"public_addr":"10.20.193.91:6803/170892896","cluster_addr":"10.20.193.91:6805/170892896","heartbeat_back_addr":"10.20.193.91:6809/170892896","heartbeat_front_addr":"10.20.193.91:6807/170892896","state":["exists","up"]},{"osd":1,"uuid":"5d698ba3-8a17-455c-b05d-8ca1c9d44466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6801","nonce":1754332231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6803","nonce":1754332231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6807","nonce":1754332231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6805","nonce":1754332231}]},"public_addr":"10.20.193.126:6801/1754332231","cluster_addr":"10.20.193.126:6803/1754332231","heartbeat_back_addr":"10.20.193.126:6807/1754332231","heartbeat_front_addr":"10.20.193.126:6805/1754332231","state":["exists","up"]},{"osd":2,"uuid":"4b9d9a44-7956-4117-ada8-cb99016ae048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6801","nonce":1701976259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6803","nonce":1701976259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6807","nonce":1701976259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6805","nonce":1701976259}]},"public_addr":"10.20.193.154:6801/1701976259","cluster_addr":"10.20.193.154:6803/1701976259","heartbeat_back_addr":"10.20.193.154:6807/1701976259","heartbeat_front_addr":"10.20.193.154:6805/1701976259","state":["exists","up"]},{"osd":3,"uuid":"bb667b65-2ce1-4131-88de-53efa7c8fb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6811","nonce":746110270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6813","nonce":746110270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6817","nonce":746110270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6815","nonce":746110270}]},"public_addr":"10.20.193.91:6811/746110270","cluster_addr":"10.20.193.91:6813/746110270","heartbeat_back_addr":"10.20.193.91:6817/746110270","heartbeat_front_addr":"10.20.193.91:6815/746110270","state":["exists","up"]},{"osd":4,"uuid":"a2569ae9-0cac-4935-94f5-bfcbd0376cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6809","nonce":2328526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6811","nonce":2328526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6815","nonce":2328526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6813","nonce":2328526761}]},"public_addr":"10.20.193.126:6809/2328526761","cluster_addr":"10.20.193.126:6811/2328526761","heartbeat_back_addr":"10.20.193.126:6815/2328526761","heartbeat_front_addr":"10.20.193.126:6813/2328526761","state":["exists","up"]},{"osd":5,"uuid":"6279cc06-cf48-430f-929b-fde87b33e114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6809","nonce":2892893681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6811","nonce":2892893681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6815","nonce":2892893681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6813","nonce":2892893681}]},"public_addr":"10.20.193.154:6809/2892893681","cluster_addr":"10.20.193.154:6811/2892893681","heartbeat_back_addr":"10.20.193.154:6815/2892893681","heartbeat_front_addr":"10.20.193.154:6813/2892893681","state":["exists","up"]},{"osd":6,"uuid":"47579bf9-6170-4408-810f-8be850659d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6819","nonce":1887880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6821","nonce":1887880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6825","nonce":1887880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6823","nonce":1887880552}]},"public_addr":"10.20.193.91:6819/1887880552","cluster_addr":"10.20.193.91:6821/1887880552","heartbeat_back_addr":"10.20.193.91:6825/1887880552","heartbeat_front_addr":"10.20.193.91:6823/1887880552","state":["exists","up"]},{"osd":7,"uuid":"5ec7f6c4-8479-4e14-855e-fa3b594f058c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6817","nonce":1270299623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6819","nonce":1270299623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6823","nonce":1270299623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6821","nonce":1270299623}]},"public_addr":"10.20.193.126:6817/1270299623","cluster_addr":"10.20.193.126:6819/1270299623","heartbeat_back_addr":"10.20.193.126:6823/1270299623","heartbeat_front_addr":"10.20.193.126:6821/1270299623","state":["exists","up"]},{"osd":8,"uuid":"19fbc479-f0bf-46d3-9d48-648388632fb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6817","nonce":1364755569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6819","nonce":1364755569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6823","nonce":1364755569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6821","nonce":1364755569}]},"public_addr":"10.20.193.154:6817/1364755569","cluster_addr":"10.20.193.154:6819/1364755569","heartbeat_back_addr":"10.20.193.154:6823/1364755569","heartbeat_front_addr":"10.20.193.154:6821/1364755569","state":["exists","up"]},{"osd":9,"uuid":"a3befdc3-c847-4659-9ec1-0dd5e3172fe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6827","nonce":1541303371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6829","nonce":1541303371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6833","nonce":1541303371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6831","nonce":1541303371}]},"public_addr":"10.20.193.91:6827/1541303371","cluster_addr":"10.20.193.91:6829/1541303371","heartbeat_back_addr":"10.20.193.91:6833/1541303371","heartbeat_front_addr":"10.20.193.91:6831/1541303371","state":["exists","up"]},{"osd":10,"uuid":"36fe781f-9334-474b-bc6b-01e798e72a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6825","nonce":3309349280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6827","nonce":3309349280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6831","nonce":3309349280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6829","nonce":3309349280}]},"public_addr":"10.20.193.126:6825/3309349280","cluster_addr":"10.20.193.126:6827/3309349280","heartbeat_back_addr":"10.20.193.126:6831/3309349280","heartbeat_front_addr":"10.20.193.126:6829/3309349280","state":["exists","up"]},{"osd":11,"uuid":"5f569e12-4d88-4cf0-8f2e-147ace91f917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6825","nonce":1394532940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6827","nonce":1394532940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6831","nonce":1394532940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6829","nonce":1394532940}]},"public_addr":"10.20.193.154:6825/1394532940","cluster_addr":"10.20.193.154:6827/1394532940","heartbeat_back_addr":"10.20.193.154:6831/1394532940","heartbeat_front_addr":"10.20.193.154:6829/1394532940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:34.061683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.894443+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:47.963906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.184288+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:02.378327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:09.561223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:16.947535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:24.187301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.493620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:38.824765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.268089+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.91:6801/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/624457179":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/335308306":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/2950715894":"2026-02-14T01:22:48.728580+0000","10.20.193.91:6801/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/3747672627":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/2063745168":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/1509443464":"2026-02-14T01:22:48.728580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb33c0b5650 msgr2=0x7fb33c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb33c0b5650 0x7fb33c0d5b00 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb354005980 tx=0x7fb354005910 comp rx=0 tx=0).stop 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 msgr2=0x7fb36011d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 0x7fb36011d250 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35000b710 tx=0x7fb35000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 shutdown_connections 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb33c0b5650 0x7fb33c0d5b00 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb360122b50 0x7fb360122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360115410 0x7fb36011d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 --2- 10.20.193.91:0/2767432122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb36010f200 0x7fb36011d250 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 >> 10.20.193.91:0/2767432122 conn(0x7fb3600ecb00 msgr2=0x7fb36010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 shutdown_connections 2026-02-13T01:24:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.333+0000 7fb3684a46c0 1 -- 10.20.193.91:0/2767432122 wait complete. 2026-02-13T01:24:56.391 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T01:23:51.498651+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T01:24:56.391 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T01:24:56.510 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:56.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- 10.20.193.91:0/3532563009 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3780115410 msgr2=0x7f3780175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- 10.20.193.91:0/3532563009 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3780115410 0x7f3780175db0 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=13953734975536197578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f377400aa70 tx=0x7f377402fde0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- 10.20.193.91:0/3532563009 shutdown_connections 2026-02-13T01:24:56.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- 10.20.193.91:0/3532563009 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3780115410 0x7f3780175db0 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=13953734975536197578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- 10.20.193.91:0/3532563009 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f378010fbf0 0x7f3780114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- 10.20.193.91:0/3532563009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f378010f200 0x7f378010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- 10.20.193.91:0/3532563009 >> 10.20.193.91:0/3532563009 conn(0x7f37800ecb00 msgr2=0x7f378010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:56.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- 10.20.193.91:0/3532563009 shutdown_connections 2026-02-13T01:24:56.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- 10.20.193.91:0/3532563009 wait complete. 2026-02-13T01:24:56.624 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: purged_snaps scrub starts 2026-02-13T01:24:56.624 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: purged_snaps scrub ok 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] boot 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2514019560' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:56.625 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2767432122' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 Processor -- start 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- start start 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 0x7f378011d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3780115410 0x7f378011d7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3780122bb0 0x7f3780123050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f37801235c0 con 0x7f378010f200 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3780123730 con 0x7f3780115410 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3786a336c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37801238f0 con 0x7f3780122bb0 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 0x7f378011d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 0x7f378011d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:57280/0 (socket says 10.20.193.91:57280) 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 -- 10.20.193.91:0/2792724761 learned_addr learned my addr 10.20.193.91:0/2792724761 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377f7fe6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3780115410 0x7f378011d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3784fa56c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3780122bb0 0x7f3780123050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 -- 10.20.193.91:0/2792724761 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3780122bb0 msgr2=0x7f3780123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3780122bb0 0x7f3780123050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 -- 10.20.193.91:0/2792724761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3780115410 msgr2=0x7f378011d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3780115410 0x7f378011d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f377ffff6c0 1 -- 10.20.193.91:0/2792724761 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377400a660 con 0x7f378010f200 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.623+0000 7f3784fa56c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3780122bb0 0x7f3780123050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f377ffff6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 0x7f378011d2b0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f376c0092e0 tx=0x7f376c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f376c004250 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f376c0043b0 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3780163da0 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f376c00cd40 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3780164280 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.624+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37801104d0 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.625+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f376c0026b0 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.626+0000 7f377d7fa6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f37540b56d0 0x7f37540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.626+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f376c0e36b0 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.626+0000 7f377f7fe6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f37540b56d0 0x7f37540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.626+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f376c0a64c0 con 0x7f378010f200 2026-02-13T01:24:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.626+0000 7f377f7fe6c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f37540b56d0 0x7f37540d5b80 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3780123c40 tx=0x7f37700094f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:56.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: purged_snaps scrub starts 2026-02-13T01:24:56.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: purged_snaps scrub ok 2026-02-13T01:24:56.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:56.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:56.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] boot 2026-02-13T01:24:56.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:24:56.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:56.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2514019560' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:56.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:56 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2767432122' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:56.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.716+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f378011e460 con 0x7f378010f200 2026-02-13T01:24:56.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.716+0000 7f377d7fa6c0 1 -- 10.20.193.91:0/2792724761 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f376c0a9670 con 0x7f378010f200 2026-02-13T01:24:56.717 INFO:teuthology.orchestra.run.trial091.stdout:pg_num: 1 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f37540b56d0 msgr2=0x7f37540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f37540b56d0 0x7f37540d5b80 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3780123c40 tx=0x7f37700094f0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 msgr2=0x7f378011d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 0x7f378011d2b0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f376c0092e0 tx=0x7f376c00bc50 comp rx=0 tx=0).stop 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 shutdown_connections 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f37540b56d0 0x7f37540d5b80 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3780122bb0 0x7f3780123050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3780115410 0x7f378011d7f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 --2- 10.20.193.91:0/2792724761 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f378010f200 0x7f378011d2b0 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:56.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 >> 10.20.193.91:0/2792724761 conn(0x7f37800ecb00 msgr2=0x7f378010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:56.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 shutdown_connections 2026-02-13T01:24:56.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:56.717+0000 7f3786a336c0 1 -- 10.20.193.91:0/2792724761 wait complete. 2026-02-13T01:24:56.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: purged_snaps scrub starts 2026-02-13T01:24:56.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: purged_snaps scrub ok 2026-02-13T01:24:56.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: pgmap v157: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T01:24:56.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:56.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: osd.11 [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] boot 2026-02-13T01:24:56.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T01:24:56.750 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T01:24:56.750 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2514019560' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T01:24:56.750 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:56 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2767432122' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.a on trial091 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.d on trial091 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.g on trial091 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.j on trial091 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.b on trial126 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.e on trial126 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.h on trial126 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.k on trial126 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.c on trial154 2026-02-13T01:24:56.758 INFO:tasks.cephadm:Adding mds.f on trial154 2026-02-13T01:24:56.759 INFO:tasks.cephadm:Adding mds.i on trial154 2026-02-13T01:24:56.759 INFO:tasks.cephadm:Adding mds.l on trial154 2026-02-13T01:24:56.759 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph orch apply mds all '12;trial091=a;trial091=d;trial091=g;trial091=j;trial126=b;trial126=e;trial126=h;trial126=k;trial154=c;trial154=f;trial154=i;trial154=l' 2026-02-13T01:24:56.880 INFO:teuthology.orchestra.run.trial154.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 -- 10.20.193.154:0/2954951454 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c10fbf0 msgr2=0x7f698c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 --2- 10.20.193.154:0/2954951454 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c10fbf0 0x7f698c114c30 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=16629646254814608310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69740099a0 tx=0x7f697402ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 -- 10.20.193.154:0/2954951454 shutdown_connections 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 --2- 10.20.193.154:0/2954951454 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f698c115410 0x7f698c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 --2- 10.20.193.154:0/2954951454 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c10fbf0 0x7f698c114c30 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=16629646254814608310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 --2- 10.20.193.154:0/2954951454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f698c10f200 0x7f698c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 -- 10.20.193.154:0/2954951454 >> 10.20.193.154:0/2954951454 conn(0x7f698c0ecb00 msgr2=0x7f698c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:57.001 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 -- 10.20.193.154:0/2954951454 shutdown_connections 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 -- 10.20.193.154:0/2954951454 wait complete. 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 Processor -- start 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.997+0000 7f69919a86c0 1 -- start start 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f698c10f200 0x7f698c0f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f698c115410 0x7f698c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 0x7f698c0fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0f59f0 con 0x7f698c115410 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0fab10 con 0x7f698c10f200 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0facd0 con 0x7f698c0f5300 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 0x7f698c0fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.002 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 0x7f698c0fa5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.154:56322/0 (socket says 10.20.193.154:56322) 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 -- 10.20.193.154:0/340791406 learned_addr learned my addr 10.20.193.154:0/340791406 (peer_addr_for_me v2:10.20.193.154:0/0) 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698a7fc6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f698c115410 0x7f698c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698affd6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f698c10f200 0x7f698c0f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 -- 10.20.193.154:0/340791406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f698c10f200 msgr2=0x7f698c0f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f698c10f200 0x7f698c0f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 -- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f698c115410 msgr2=0x7f698c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f698c115410 0x7f698c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 -- 10.20.193.154:0/340791406 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6974009590 con 0x7f698c0f5300 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f698b7fe6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 0x7f698c0fa5d0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f697c00c800 tx=0x7f697c00ccd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f697c003a30 con 0x7f698c0f5300 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c0fafb0 con 0x7f698c0f5300 2026-02-13T01:24:57.003 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f697c0054f0 con 0x7f698c0f5300 2026-02-13T01:24:57.004 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f697c00dc30 con 0x7f698c0f5300 2026-02-13T01:24:57.004 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.998+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c0fb740 con 0x7f698c0f5300 2026-02-13T01:24:57.004 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:56.999+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6950005310 con 0x7f698c0f5300 2026-02-13T01:24:57.005 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.000+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f697c005030 con 0x7f698c0f5300 2026-02-13T01:24:57.005 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.001+0000 7f69909a26c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69600b56d0 0x7f69600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.005 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.001+0000 7f698affd6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69600b56d0 0x7f69600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.005 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.001+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f697c0e4660 con 0x7f698c0f5300 2026-02-13T01:24:57.005 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.001+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f697c0a7470 con 0x7f698c0f5300 2026-02-13T01:24:57.005 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.001+0000 7f698affd6c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69600b56d0 0x7f69600d5b80 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6980004750 tx=0x7f6980009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:57.102 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.100+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial091=a;trial091=d;trial091=g;trial091=j;trial126=b;trial126=e;trial126=h;trial126=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}) -- 0x7f6950002bc0 con 0x7f69600b56d0 2026-02-13T01:24:57.108 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.106+0000 7f69909a26c0 1 -- 10.20.193.154:0/340791406 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6950002bc0 con 0x7f69600b56d0 2026-02-13T01:24:57.108 INFO:teuthology.orchestra.run.trial154.stdout:Scheduled mds.all update... 2026-02-13T01:24:57.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69600b56d0 msgr2=0x7f69600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69600b56d0 0x7f69600d5b80 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6980004750 tx=0x7f6980009390 comp rx=0 tx=0).stop 2026-02-13T01:24:57.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 msgr2=0x7f698c0fa5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 0x7f698c0fa5d0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f697c00c800 tx=0x7f697c00ccd0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 shutdown_connections 2026-02-13T01:24:57.110 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f69600b56d0 0x7f69600d5b80 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.111 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f698c0f5300 0x7f698c0fa5d0 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.111 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f698c115410 0x7f698c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.111 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 --2- 10.20.193.154:0/340791406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f698c10f200 0x7f698c0f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.111 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 >> 10.20.193.154:0/340791406 conn(0x7f698c0ecb00 msgr2=0x7f698c10d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:57.111 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 shutdown_connections 2026-02-13T01:24:57.111 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-13T01:24:57.108+0000 7f69919a86c0 1 -- 10.20.193.154:0/340791406 wait complete. 2026-02-13T01:24:57.178 DEBUG:teuthology.orchestra.run.trial091:mds.a> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.a.service 2026-02-13T01:24:57.181 DEBUG:teuthology.orchestra.run.trial091:mds.d> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.d.service 2026-02-13T01:24:57.224 DEBUG:teuthology.orchestra.run.trial091:mds.g> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.g.service 2026-02-13T01:24:57.267 DEBUG:teuthology.orchestra.run.trial091:mds.j> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.j.service 2026-02-13T01:24:57.310 DEBUG:teuthology.orchestra.run.trial126:mds.b> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.b.service 2026-02-13T01:24:57.314 DEBUG:teuthology.orchestra.run.trial126:mds.e> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.e.service 2026-02-13T01:24:57.357 DEBUG:teuthology.orchestra.run.trial126:mds.h> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.h.service 2026-02-13T01:24:57.401 DEBUG:teuthology.orchestra.run.trial126:mds.k> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.k.service 2026-02-13T01:24:57.444 DEBUG:teuthology.orchestra.run.trial154:mds.c> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.c.service 2026-02-13T01:24:57.446 DEBUG:teuthology.orchestra.run.trial154:mds.f> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.f.service 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2792724761' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:57.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:57.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:57 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.489 DEBUG:teuthology.orchestra.run.trial154:mds.i> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.i.service 2026-02-13T01:24:57.533 DEBUG:teuthology.orchestra.run.trial154:mds.l> sudo journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.l.service 2026-02-13T01:24:57.577 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T01:24:57.577 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:24:57.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:24:57.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2792724761' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:24:57.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:57.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:57.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:57.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:57.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:57.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:57.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:57 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.670 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T01:24:57.670 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2792724761' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T01:24:57.670 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:24:57.671 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:57 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:57.694 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/622567795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc010fbf0 msgr2=0x7f6fc0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/622567795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc010fbf0 0x7f6fc0114c30 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=12832858276731532955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb40099a0 tx=0x7f6fb402ed20 comp rx=0 tx=0).stop 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/622567795 shutdown_connections 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/622567795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6fc0115410 0x7f6fc0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/622567795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc010fbf0 0x7f6fc0114c30 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=12832858276731532955 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/622567795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc010f200 0x7f6fc010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/622567795 >> 10.20.193.91:0/622567795 conn(0x7f6fc00ecb00 msgr2=0x7f6fc010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:57.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/622567795 shutdown_connections 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/622567795 wait complete. 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 Processor -- start 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- start start 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6fc010f200 0x7f6fc00f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 0x7f6fc0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc00f5310 0x7f6fc00fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00f5a00 con 0x7f6fc0115410 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00fab20 con 0x7f6fc00f5310 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc778c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc00face0 con 0x7f6fc010f200 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 0x7f6fc0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 0x7f6fc0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:47496/0 (socket says 10.20.193.91:47496) 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 -- 10.20.193.91:0/1231841878 learned_addr learned my addr 10.20.193.91:0/1231841878 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc5d026c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc00f5310 0x7f6fc00fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 -- 10.20.193.91:0/1231841878 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6fc010f200 msgr2=0x7f6fc00f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6fc010f200 0x7f6fc00f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 -- 10.20.193.91:0/1231841878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc00f5310 msgr2=0x7f6fc00fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.811+0000 7f6fc4d006c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc00f5310 0x7f6fc00fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fc4d006c0 1 -- 10.20.193.91:0/1231841878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb4009590 con 0x7f6fc0115410 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fc5d026c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc00f5310 0x7f6fc00fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fc4d006c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 0x7f6fc0175cb0 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb40023c0 tx=0x7f6fb402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fb4002ae0 con 0x7f6fc0115410 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6fb4002c40 con 0x7f6fc0115410 2026-02-13T01:24:57.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc00faf60 con 0x7f6fc0115410 2026-02-13T01:24:57.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6fb40372f0 con 0x7f6fc0115410 2026-02-13T01:24:57.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc00fb430 con 0x7f6fc0115410 2026-02-13T01:24:57.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.812+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fc01104d0 con 0x7f6fc0115410 2026-02-13T01:24:57.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.813+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f6fb4007810 con 0x7f6fc0115410 2026-02-13T01:24:57.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.814+0000 7f6fae7fc6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6f9c0b56d0 0x7f6f9c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:24:57.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.814+0000 7f6fc55016c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6f9c0b56d0 0x7f6f9c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:24:57.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.814+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f6fb4107840 con 0x7f6fc0115410 2026-02-13T01:24:57.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.814+0000 7f6fc55016c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6f9c0b56d0 0x7f6f9c0d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb0005980 tx=0x7f6fb0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:24:57.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.814+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6fb40ca650 con 0x7f6fc0115410 2026-02-13T01:24:57.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.930+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fc010f5d0 con 0x7f6fc0115410 2026-02-13T01:24:57.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.931+0000 7f6fae7fc6c0 1 -- 10.20.193.91:0/1231841878 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f6fb4007e60 con 0x7f6fc0115410 2026-02-13T01:24:57.931 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:24:57.931 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":1,"btime":"2026-02-13T01:22:42:667323+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T01:24:57.932 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 1 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6f9c0b56d0 msgr2=0x7f6f9c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6f9c0b56d0 0x7f6f9c0d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb0005980 tx=0x7f6fb0005910 comp rx=0 tx=0).stop 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 msgr2=0x7f6fc0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 0x7f6fc0175cb0 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6fb40023c0 tx=0x7f6fb402fbf0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 shutdown_connections 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6f9c0b56d0 0x7f6f9c0d5b80 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6fc00f5310 0x7f6fc00fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6fc0115410 0x7f6fc0175cb0 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 --2- 10.20.193.91:0/1231841878 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6fc010f200 0x7f6fc00f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:24:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 >> 10.20.193.91:0/1231841878 conn(0x7f6fc00ecb00 msgr2=0x7f6fc010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:24:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 shutdown_connections 2026-02-13T01:24:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:24:57.932+0000 7f6fc778c6c0 1 -- 10.20.193.91:0/1231841878 wait complete. 2026-02-13T01:24:58.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial091=a;trial091=d;trial091=g;trial091=j;trial126=b;trial126=e;trial126=h;trial126=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:58.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:58 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1231841878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:24:58.717 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 01:24:58 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-l[55976]: starting mds.l at 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial091=a;trial091=d;trial091=g;trial091=j;trial126=b;trial126=e;trial126=h;trial126=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:58.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:58 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1231841878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:24:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial091=a;trial091=d;trial091=g;trial091=j;trial126=b;trial126=e;trial126=h;trial126=k;trial154=c;trial154=f;trial154=i;trial154=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:24:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:24:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:24:58.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:58.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:58.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:58.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:58 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1231841878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:24:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.154:6832/3628315638,v1:10.20.193.154:6833/3628315638] up:boot 2026-02-13T01:24:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: fsmap 1 up:standby 2026-02-13T01:24:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:59.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:24:59 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.709 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:59.709 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:59.709 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.154:6832/3628315638,v1:10.20.193.154:6833/3628315638] up:boot 2026-02-13T01:24:59.709 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: fsmap 1 up:standby 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:59.710 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:59.711 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:24:59 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:24:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:24:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.154:6832/3628315638,v1:10.20.193.154:6833/3628315638] up:boot 2026-02-13T01:24:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: fsmap 1 up:standby 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:24:59.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:24:59.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:24:59 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:24:59.972 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:00.105 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 -- 10.20.193.91:0/512551562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010d9a0 msgr2=0x7f77801129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 --2- 10.20.193.91:0/512551562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010d9a0 0x7f77801129e0 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=3238483954218598337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77680099a0 tx=0x7f776802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 -- 10.20.193.91:0/512551562 shutdown_connections 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 --2- 10.20.193.91:0/512551562 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77801131c0 0x7f7780173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 --2- 10.20.193.91:0/512551562 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010d9a0 0x7f77801129e0 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=3238483954218598337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 --2- 10.20.193.91:0/512551562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f778010cfb0 0x7f778010d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 -- 10.20.193.91:0/512551562 >> 10.20.193.91:0/512551562 conn(0x7f77800ea8b0 msgr2=0x7f778010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 -- 10.20.193.91:0/512551562 shutdown_connections 2026-02-13T01:25:00.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 -- 10.20.193.91:0/512551562 wait complete. 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 Processor -- start 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 -- start start 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.218+0000 7f77852616c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 0x7f77800f2a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77801131c0 0x7f7780173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77800f3070 0x7f77800f8340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f77800f3760 con 0x7f778010cfb0 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f77800f8880 con 0x7f77800f3070 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77800f8a40 con 0x7f77801131c0 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 0x7f77800f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 0x7f77800f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:47542/0 (socket says 10.20.193.91:47542) 2026-02-13T01:25:00.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 -- 10.20.193.91:0/2263868645 learned_addr learned my addr 10.20.193.91:0/2263868645 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777f5776c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77800f3070 0x7f77800f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777e5756c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77801131c0 0x7f7780173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 -- 10.20.193.91:0/2263868645 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77801131c0 msgr2=0x7f7780173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77801131c0 0x7f7780173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 -- 10.20.193.91:0/2263868645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77800f3070 msgr2=0x7f77800f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77800f3070 0x7f77800f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 -- 10.20.193.91:0/2263868645 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7768009590 con 0x7f778010cfb0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f777ed766c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 0x7f77800f2a40 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f777400b6c0 tx=0x7f777400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77740044a0 con 0x7f778010cfb0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77800f8d20 con 0x7f778010cfb0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7774009030 con 0x7f778010cfb0 2026-02-13T01:25:00.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f777400cc10 con 0x7f778010cfb0 2026-02-13T01:25:00.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77800f94b0 con 0x7f778010cfb0 2026-02-13T01:25:00.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.219+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778010e280 con 0x7f778010cfb0 2026-02-13T01:25:00.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.221+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7774005080 con 0x7f778010cfb0 2026-02-13T01:25:00.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.221+0000 7f775ffff6c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77540b56d0 0x7f77540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:00.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.221+0000 7f777e5756c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77540b56d0 0x7f77540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:00.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.222+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f77740e3570 con 0x7f778010cfb0 2026-02-13T01:25:00.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.222+0000 7f777e5756c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77540b56d0 0x7f77540d5b80 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7768005b40 tx=0x7f7768005c20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:00.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.222+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77740a6410 con 0x7f778010cfb0 2026-02-13T01:25:00.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.339+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77800f3bf0 con 0x7f778010cfb0 2026-02-13T01:25:00.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.339+0000 7f775ffff6c0 1 -- 10.20.193.91:0/2263868645 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f77740a9530 con 0x7f778010cfb0 2026-02-13T01:25:00.340 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:00.340 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":3,"btime":"2026-02-13T01:24:59:540156+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24526,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3628315638","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3628315638},{"type":"v1","addr":"10.20.193.154:6833","nonce":3628315638}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/2773810578","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":2773810578},{"type":"v1","addr":"10.20.193.126:6833","nonce":2773810578}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T01:25:00.340 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 3 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77540b56d0 msgr2=0x7f77540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77540b56d0 0x7f77540d5b80 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7768005b40 tx=0x7f7768005c20 comp rx=0 tx=0).stop 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 msgr2=0x7f77800f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 0x7f77800f2a40 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f777400b6c0 tx=0x7f777400bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 shutdown_connections 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77540b56d0 0x7f77540d5b80 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77800f3070 0x7f77800f8340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77801131c0 0x7f7780173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 --2- 10.20.193.91:0/2263868645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f778010cfb0 0x7f77800f2a40 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:00.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 >> 10.20.193.91:0/2263868645 conn(0x7f77800ea8b0 msgr2=0x7f778010b650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:00.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 shutdown_connections 2026-02-13T01:25:00.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:00.341+0000 7f77852616c0 1 -- 10.20.193.91:0/2263868645 wait complete. 2026-02-13T01:25:00.592 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6832/2773810578,v1:10.20.193.126:6833/2773810578] up:boot 2026-02-13T01:25:00.592 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: fsmap 2 up:standby 2026-02-13T01:25:00.592 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:00.593 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:00 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2263868645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6832/2773810578,v1:10.20.193.126:6833/2773810578] up:boot 2026-02-13T01:25:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: fsmap 2 up:standby 2026-02-13T01:25:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:25:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:00 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2263868645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:00.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6832/2773810578,v1:10.20.193.126:6833/2773810578] up:boot 2026-02-13T01:25:00.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: fsmap 2 up:standby 2026-02-13T01:25:00.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T01:25:00.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:00.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:00.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:00.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:00.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:00.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:00 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2263868645' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:01.228 INFO:journalctl@ceph.mds.d.trial091.stdout:Feb 13 01:25:01 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-d[62889]: starting mds.d at 2026-02-13T01:25:01.714 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.91:6834/2335686987,v1:10.20.193.91:6835/2335686987] up:boot 2026-02-13T01:25:01.714 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: fsmap 3 up:standby 2026-02-13T01:25:01.714 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:25:01.714 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.714 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.715 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.715 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:01.715 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:01.715 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:01 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.91:6834/2335686987,v1:10.20.193.91:6835/2335686987] up:boot 2026-02-13T01:25:01.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: fsmap 3 up:standby 2026-02-13T01:25:01.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:25:01.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:01.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:01.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:01 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.91:6834/2335686987,v1:10.20.193.91:6835/2335686987] up:boot 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: fsmap 3 up:standby 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:01 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.098 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 13 01:25:01 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-e[55750]: starting mds.e at 2026-02-13T01:25:02.385 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:02.509 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:02.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- 10.20.193.91:0/432206460 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c113190 msgr2=0x7f757c173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:02.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- 10.20.193.91:0/432206460 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c113190 0x7f757c173b30 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=12755814733012520974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f757800aa70 tx=0x7f757802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- 10.20.193.91:0/432206460 shutdown_connections 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- 10.20.193.91:0/432206460 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c113190 0x7f757c173b30 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=12755814733012520974 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- 10.20.193.91:0/432206460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c10d970 0x7f757c1129b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- 10.20.193.91:0/432206460 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f757c10cf80 0x7f757c10d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- 10.20.193.91:0/432206460 >> 10.20.193.91:0/432206460 conn(0x7f757c0ea880 msgr2=0x7f757c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- 10.20.193.91:0/432206460 shutdown_connections 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- 10.20.193.91:0/432206460 wait complete. 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 Processor -- start 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- start start 2026-02-13T01:25:02.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f757c10cf80 0x7f757c060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c113190 0x7f757c060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 0x7f757c163260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f757c1637a0 con 0x7f757c061180 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f757c163910 con 0x7f757c113190 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75831c56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f757c163ad0 con 0x7f757c10cf80 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75817376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 0x7f757c163260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75817376c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 0x7f757c163260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:47566/0 (socket says 10.20.193.91:47566) 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.636+0000 7f75817376c0 1 -- 10.20.193.91:0/325163820 learned_addr learned my addr 10.20.193.91:0/325163820 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f7573fff6c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c113190 0x7f757c060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f7580f366c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f757c10cf80 0x7f757c060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75817376c0 1 -- 10.20.193.91:0/325163820 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f757c10cf80 msgr2=0x7f757c060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:02.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75817376c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f757c10cf80 0x7f757c060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75817376c0 1 -- 10.20.193.91:0/325163820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c113190 msgr2=0x7f757c060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75817376c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c113190 0x7f757c060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75817376c0 1 -- 10.20.193.91:0/325163820 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757800a660 con 0x7f757c061180 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f7573fff6c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c113190 0x7f757c060c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75817376c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 0x7f757c163260 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75780055f0 tx=0x7f7578005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7578003c40 con 0x7f757c061180 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7578003da0 con 0x7f757c061180 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c163d50 con 0x7f757c061180 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7578038480 con 0x7f757c061180 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c1641d0 con 0x7f757c061180 2026-02-13T01:25:02.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.637+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c10e250 con 0x7f757c061180 2026-02-13T01:25:02.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.638+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7578008260 con 0x7f757c061180 2026-02-13T01:25:02.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.639+0000 7f7571ffb6c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f75580b56d0 0x7f75580d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:02.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.639+0000 7f7580f366c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f75580b56d0 0x7f75580d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:02.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.639+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f7578108bd0 con 0x7f757c061180 2026-02-13T01:25:02.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.639+0000 7f7580f366c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f75580b56d0 0x7f75580d5b80 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f756c005980 tx=0x7f756c005ee0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:02.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.640+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f75780cb9e0 con 0x7f757c061180 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.91:6836/1529166455,v1:10.20.193.91:6837/1529166455] up:boot 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: fsmap 4 up:standby 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:02.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:02 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.756+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f757c10d350 con 0x7f757c061180 2026-02-13T01:25:02.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.756+0000 7f7571ffb6c0 1 -- 10.20.193.91:0/325163820 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f75780ceb90 con 0x7f757c061180 2026-02-13T01:25:02.757 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:02.757 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":6,"btime":"2026-02-13T01:25:02:549031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14745,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2335686987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2335686987},{"type":"v1","addr":"10.20.193.91:6835","nonce":2335686987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/1529166455","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":1529166455},{"type":"v1","addr":"10.20.193.91:6837","nonce":1529166455}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24526,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3628315638","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3628315638},{"type":"v1","addr":"10.20.193.154:6833","nonce":3628315638}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/2773810578","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":2773810578},{"type":"v1","addr":"10.20.193.126:6833","nonce":2773810578}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/1202805209","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":1202805209},{"type":"v1","addr":"10.20.193.126:6835","nonce":1202805209}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2026-02-13T01:25:02.757 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 6 2026-02-13T01:25:02.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f75580b56d0 msgr2=0x7f75580d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:02.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f75580b56d0 0x7f75580d5b80 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f756c005980 tx=0x7f756c005ee0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 msgr2=0x7f757c163260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 0x7f757c163260 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75780055f0 tx=0x7f7578005620 comp rx=0 tx=0).stop 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 shutdown_connections 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f75580b56d0 0x7f75580d5b80 unknown :-1 s=CLOSED pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f757c061180 0x7f757c163260 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f757c113190 0x7f757c060c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 --2- 10.20.193.91:0/325163820 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f757c10cf80 0x7f757c060700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 >> 10.20.193.91:0/325163820 conn(0x7f757c0ea880 msgr2=0x7f757c10ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 shutdown_connections 2026-02-13T01:25:02.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:02.758+0000 7f75831c56c0 1 -- 10.20.193.91:0/325163820 wait complete. 2026-02-13T01:25:02.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.91:6836/1529166455,v1:10.20.193.91:6837/1529166455] up:boot 2026-02-13T01:25:02.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: fsmap 4 up:standby 2026-02-13T01:25:02.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:02.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:02 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.91:6836/1529166455,v1:10.20.193.91:6837/1529166455] up:boot 2026-02-13T01:25:02.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: fsmap 4 up:standby 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:02 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:02.966 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 01:25:02 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-f[56300]: starting mds.f at 2026-02-13T01:25:03.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6834/1202805209,v1:10.20.193.126:6835/1202805209] up:boot 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: fsmap 5 up:standby 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/325163820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:03.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:03.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:03 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6834/1202805209,v1:10.20.193.126:6835/1202805209] up:boot 2026-02-13T01:25:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: fsmap 5 up:standby 2026-02-13T01:25:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:25:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/325163820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:03 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6834/1202805209,v1:10.20.193.126:6835/1202805209] up:boot 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: fsmap 5 up:standby 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/325163820' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:03.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:03 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:04.558 INFO:journalctl@ceph.mds.h.trial126.stdout:Feb 13 01:25:04 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-h[56074]: starting mds.h at 2026-02-13T01:25:04.801 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:04.827 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.154:6834/2887274444,v1:10.20.193.154:6835/2887274444] up:boot 2026-02-13T01:25:04.827 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.154:6836/1555539539,v1:10.20.193.154:6837/1555539539] up:boot 2026-02-13T01:25:04.827 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: fsmap 7 up:standby 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:04.828 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:04 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.154:6834/2887274444,v1:10.20.193.154:6835/2887274444] up:boot 2026-02-13T01:25:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.154:6836/1555539539,v1:10.20.193.154:6837/1555539539] up:boot 2026-02-13T01:25:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: fsmap 7 up:standby 2026-02-13T01:25:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:25:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:04 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:04.893 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.154:6834/2887274444,v1:10.20.193.154:6835/2887274444] up:boot 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.154:6836/1555539539,v1:10.20.193.154:6837/1555539539] up:boot 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: fsmap 7 up:standby 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:04.894 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:04.895 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:04 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:04.922 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:05.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 -- 10.20.193.91:0/1615742429 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc116380 msgr2=0x7f51fc11b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 --2- 10.20.193.91:0/1615742429 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc116380 0x7f51fc11b3c0 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=4869423628291174833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51e40099a0 tx=0x7f51e402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 -- 10.20.193.91:0/1615742429 shutdown_connections 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 --2- 10.20.193.91:0/1615742429 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 --2- 10.20.193.91:0/1615742429 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc116380 0x7f51fc11b3c0 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=4869423628291174833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 --2- 10.20.193.91:0/1615742429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f51fc115990 0x7f51fc115d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 -- 10.20.193.91:0/1615742429 >> 10.20.193.91:0/1615742429 conn(0x7f51fc05e060 msgr2=0x7f51fc05e460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.038+0000 7f520184b6c0 1 -- 10.20.193.91:0/1615742429 shutdown_connections 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- 10.20.193.91:0/1615742429 wait complete. 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 Processor -- start 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- start start 2026-02-13T01:25:05.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc115990 0x7f51fc0fd750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f51fc0fdd80 0x7f51fc103050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0fe470 con 0x7f51fc11bba0 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc103590 con 0x7f51fc0fdd80 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc103750 con 0x7f51fc115990 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:47592/0 (socket says 10.20.193.91:47592) 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 -- 10.20.193.91:0/2298357457 learned_addr learned my addr 10.20.193.91:0/2298357457 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fb7fe6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f51fc0fdd80 0x7f51fc103050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51faffd6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc115990 0x7f51fc0fd750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 -- 10.20.193.91:0/2298357457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc115990 msgr2=0x7f51fc0fd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc115990 0x7f51fc0fd750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 -- 10.20.193.91:0/2298357457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f51fc0fdd80 msgr2=0x7f51fc103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f51fc0fdd80 0x7f51fc103050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 -- 10.20.193.91:0/2298357457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e4009590 con 0x7f51fc11bba0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51faffd6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc115990 0x7f51fc0fd750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f51fa7fc6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c440 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51e40023c0 tx=0x7f51e402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51e4002ae0 con 0x7f51fc11bba0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f51e4002c40 con 0x7f51fc11bba0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc1039d0 con 0x7f51fc11bba0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51e40372f0 con 0x7f51fc11bba0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.039+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc103ea0 con 0x7f51fc11bba0 2026-02-13T01:25:05.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.040+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51fc116c60 con 0x7f51fc11bba0 2026-02-13T01:25:05.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.041+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f51e4007810 con 0x7f51fc11bba0 2026-02-13T01:25:05.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.042+0000 7f52008456c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f51d00b56d0 0x7f51d00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:05.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.042+0000 7f51faffd6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f51d00b56d0 0x7f51d00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:05.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.042+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f51e4107840 con 0x7f51fc11bba0 2026-02-13T01:25:05.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.042+0000 7f51faffd6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f51d00b56d0 0x7f51d00d5b80 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51f0004750 tx=0x7f51f0005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:05.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.043+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f51e40ca650 con 0x7f51fc11bba0 2026-02-13T01:25:05.146 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:25:05 trial154 podman[56922]: 2026-02-13 01:25:05.144789836 +0000 UTC m=+0.048866680 container start dcae394abe1ea61861ba6096f0355ef174f3c355edb7394cab286de1b058114f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-i, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:25:05.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.158+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51fc115d60 con 0x7f51fc11bba0 2026-02-13T01:25:05.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.159+0000 7f52008456c0 1 -- 10.20.193.91:0/2298357457 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+7225 (secure 0 0 0) 0x7f51e4007e60 con 0x7f51fc11bba0 2026-02-13T01:25:05.159 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:05.160 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":8,"btime":"2026-02-13T01:25:04:555451+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14745,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2335686987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2335686987},{"type":"v1","addr":"10.20.193.91:6835","nonce":2335686987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/1529166455","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":1529166455},{"type":"v1","addr":"10.20.193.91:6837","nonce":1529166455}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24526,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3628315638","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3628315638},{"type":"v1","addr":"10.20.193.154:6833","nonce":3628315638}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6835/2887274444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":2887274444},{"type":"v1","addr":"10.20.193.154:6835","nonce":2887274444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6837/1555539539","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":1555539539},{"type":"v1","addr":"10.20.193.154:6837","nonce":1555539539}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/2773810578","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":2773810578},{"type":"v1","addr":"10.20.193.126:6833","nonce":2773810578}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/1202805209","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":1202805209},{"type":"v1","addr":"10.20.193.126:6835","nonce":1202805209}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/223325597","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":223325597},{"type":"v1","addr":"10.20.193.126:6837","nonce":223325597}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 8 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f51d00b56d0 msgr2=0x7f51d00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f51d00b56d0 0x7f51d00d5b80 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51f0004750 tx=0x7f51f0005f10 comp rx=0 tx=0).stop 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 msgr2=0x7f51fc17c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c440 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51e40023c0 tx=0x7f51e402fbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 shutdown_connections 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f51d00b56d0 0x7f51d00d5b80 unknown :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f51fc0fdd80 0x7f51fc103050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51fc11bba0 0x7f51fc17c440 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 --2- 10.20.193.91:0/2298357457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51fc115990 0x7f51fc0fd750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:05.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 >> 10.20.193.91:0/2298357457 conn(0x7f51fc05e060 msgr2=0x7f51fc11a220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:05.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 shutdown_connections 2026-02-13T01:25:05.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:05.160+0000 7f520184b6c0 1 -- 10.20.193.91:0/2298357457 wait complete. 2026-02-13T01:25:05.465 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:25:05 trial154 bash[56922]: dcae394abe1ea61861ba6096f0355ef174f3c355edb7394cab286de1b058114f 2026-02-13T01:25:05.466 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:25:05 trial154 podman[56922]: 2026-02-13 01:25:05.105773447 +0000 UTC m=+0.009850281 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:25:05.466 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:25:05 trial154 systemd[1]: Started Ceph mds.i for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:25:05.466 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mds[56949]: -- 10.20.193.154:0/1534009633 <== mon.1 v2:10.20.193.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d89fbb860 con 0x562d8a071400 2026-02-13T01:25:05.466 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:25:05 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-i[56945]: starting mds.i at 2026-02-13T01:25:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6836/223325597,v1:10.20.193.126:6837/223325597] up:boot 2026-02-13T01:25:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: fsmap 8 up:standby 2026-02-13T01:25:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:25:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2298357457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:05 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:05.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6836/223325597,v1:10.20.193.126:6837/223325597] up:boot 2026-02-13T01:25:05.867 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: fsmap 8 up:standby 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2298357457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:05.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:05 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:05.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6836/223325597,v1:10.20.193.126:6837/223325597] up:boot 2026-02-13T01:25:05.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: fsmap 8 up:standby 2026-02-13T01:25:05.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T01:25:05.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2298357457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:05.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:05.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:05.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:05.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:05 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.228 INFO:journalctl@ceph.mds.g.trial091.stdout:Feb 13 01:25:05 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-g[63425]: starting mds.g at 2026-02-13T01:25:06.698 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.154:6838/987021594,v1:10.20.193.154:6839/987021594] up:boot 2026-02-13T01:25:06.698 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: fsmap 9 up:standby 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:06.699 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.154:6838/987021594,v1:10.20.193.154:6839/987021594] up:boot 2026-02-13T01:25:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: fsmap 9 up:standby 2026-02-13T01:25:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:25:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:06.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:06.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:06 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.154:6838/987021594,v1:10.20.193.154:6839/987021594] up:boot 2026-02-13T01:25:06.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: fsmap 9 up:standby 2026-02-13T01:25:06.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T01:25:06.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:06.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:06.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:06.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:06.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:06 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:06.978 INFO:journalctl@ceph.mds.a.trial091.stdout:Feb 13 01:25:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-a[63750]: starting mds.a at 2026-02-13T01:25:07.203 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:07.322 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:07.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- 10.20.193.91:0/2935699074 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010cfe0 msgr2=0x7fb2201118b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:07.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- 10.20.193.91:0/2935699074 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010cfe0 0x7fb2201118b0 secure :-1 s=READY pgs=199 gs=1 cs=0 l=1 c_cookie=4198779408249939191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2080099a0 tx=0x7fb20802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:07.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- 10.20.193.91:0/2935699074 shutdown_connections 2026-02-13T01:25:07.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- 10.20.193.91:0/2935699074 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb220112090 0x7fb220172a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- 10.20.193.91:0/2935699074 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010cfe0 0x7fb2201118b0 unknown :-1 s=CLOSED pgs=199 gs=1 cs=0 l=1 c_cookie=4198779408249939191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- 10.20.193.91:0/2935699074 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb22010c5f0 0x7fb22010c9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- 10.20.193.91:0/2935699074 >> 10.20.193.91:0/2935699074 conn(0x7fb220062e00 msgr2=0x7fb220109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- 10.20.193.91:0/2935699074 shutdown_connections 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- 10.20.193.91:0/2935699074 wait complete. 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 Processor -- start 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- start start 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 0x7fb2200f3eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb220112090 0x7fb220172930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:07.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2200f44e0 0x7fb2200f97b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb2200f4bd0 con 0x7fb22010c5f0 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb2200f9cf0 con 0x7fb220112090 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2271836c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2200f9eb0 con 0x7fb2200f44e0 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 0x7fb2200f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 0x7fb2200f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50086/0 (socket says 10.20.193.91:50086) 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 -- 10.20.193.91:0/785489712 learned_addr learned my addr 10.20.193.91:0/785489712 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb2256f56c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2200f44e0 0x7fb2200f97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 -- 10.20.193.91:0/785489712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2200f44e0 msgr2=0x7fb2200f97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2200f44e0 0x7fb2200f97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 -- 10.20.193.91:0/785489712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb220112090 msgr2=0x7fb220172930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:07.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb220112090 0x7fb220172930 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.445+0000 7fb224ef46c0 1 -- 10.20.193.91:0/785489712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb208009590 con 0x7fb22010c5f0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb224ef46c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 0x7fb2200f3eb0 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21000b710 tx=0x7fb21000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb210004250 con 0x7fb22010c5f0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb210002d80 con 0x7fb22010c5f0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2200fa190 con 0x7fb22010c5f0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb21000cda0 con 0x7fb22010c5f0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2200fa920 con 0x7fb22010c5f0 2026-02-13T01:25:07.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.446+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22005f220 con 0x7fb22010c5f0 2026-02-13T01:25:07.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.448+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb2100028c0 con 0x7fb22010c5f0 2026-02-13T01:25:07.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.448+0000 7fb215ffb6c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb1fc0b5650 0x7fb1fc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:07.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.448+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fb2100e3800 con 0x7fb22010c5f0 2026-02-13T01:25:07.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.448+0000 7fb217fff6c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb1fc0b5650 0x7fb1fc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:07.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.448+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb2100e3c80 con 0x7fb22010c5f0 2026-02-13T01:25:07.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.448+0000 7fb217fff6c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb1fc0b5650 0x7fb1fc0d5b00 secure :-1 s=READY pgs=127 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2080098c0 tx=0x7fb2080023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:07.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.562+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2200f5000 con 0x7fb22010c5f0 2026-02-13T01:25:07.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.563+0000 7fb215ffb6c0 1 -- 10.20.193.91:0/785489712 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8874 (secure 0 0 0) 0x7fb2100a6610 con 0x7fb22010c5f0 2026-02-13T01:25:07.563 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:07.564 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":10,"btime":"2026-02-13T01:25:06:563053+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14745,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2335686987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2335686987},{"type":"v1","addr":"10.20.193.91:6835","nonce":2335686987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/1529166455","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":1529166455},{"type":"v1","addr":"10.20.193.91:6837","nonce":1529166455}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14793,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6839/330713711","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6838","nonce":330713711},{"type":"v1","addr":"10.20.193.91:6839","nonce":330713711}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24526,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3628315638","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3628315638},{"type":"v1","addr":"10.20.193.154:6833","nonce":3628315638}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6835/2887274444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":2887274444},{"type":"v1","addr":"10.20.193.154:6835","nonce":2887274444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6837/1555539539","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":1555539539},{"type":"v1","addr":"10.20.193.154:6837","nonce":1555539539}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/2773810578","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":2773810578},{"type":"v1","addr":"10.20.193.126:6833","nonce":2773810578}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6839/987021594","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6838","nonce":987021594},{"type":"v1","addr":"10.20.193.154:6839","nonce":987021594}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/1202805209","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":1202805209},{"type":"v1","addr":"10.20.193.126:6835","nonce":1202805209}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/223325597","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":223325597},{"type":"v1","addr":"10.20.193.126:6837","nonce":223325597}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 10 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.563+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb1fc0b5650 msgr2=0x7fb1fc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.563+0000 7fb2271836c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb1fc0b5650 0x7fb1fc0d5b00 secure :-1 s=READY pgs=127 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb2080098c0 tx=0x7fb2080023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.563+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 msgr2=0x7fb2200f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.563+0000 7fb2271836c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 0x7fb2200f3eb0 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb21000b710 tx=0x7fb21000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 shutdown_connections 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb1fc0b5650 0x7fb1fc0d5b00 unknown :-1 s=CLOSED pgs=127 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb2200f44e0 0x7fb2200f97b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb220112090 0x7fb220172930 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 --2- 10.20.193.91:0/785489712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb22010c5f0 0x7fb2200f3eb0 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:07.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 >> 10.20.193.91:0/785489712 conn(0x7fb220062e00 msgr2=0x7fb22010e670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:07.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 shutdown_connections 2026-02-13T01:25:07.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:07.564+0000 7fb2271836c0 1 -- 10.20.193.91:0/785489712 wait complete. 2026-02-13T01:25:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.91:6838/330713711,v1:10.20.193.91:6839/330713711] up:boot 2026-02-13T01:25:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: fsmap 10 up:standby 2026-02-13T01:25:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/785489712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:07.849 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:25:07 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: starting mds.b at 2026-02-13T01:25:07.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.91:6838/330713711,v1:10.20.193.91:6839/330713711] up:boot 2026-02-13T01:25:07.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: fsmap 10 up:standby 2026-02-13T01:25:07.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:07 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/785489712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.91:6838/330713711,v1:10.20.193.91:6839/330713711] up:boot 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: fsmap 10 up:standby 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T01:25:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:07.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:07 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/785489712' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:08.572 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.91:6840/3913743624,v1:10.20.193.91:6841/3913743624] up:boot 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: fsmap 11 up:standby 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.573 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.574 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.574 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.574 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.574 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.828 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:08.828 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:08.829 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.829 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:08.829 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:08.829 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:08.829 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:08 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.91:6840/3913743624,v1:10.20.193.91:6841/3913743624] up:boot 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: fsmap 11 up:standby 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:08.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:08 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:08.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.91:6840/3913743624,v1:10.20.193.91:6841/3913743624] up:boot 2026-02-13T01:25:08.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: fsmap 11 up:standby 2026-02-13T01:25:08.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T01:25:08.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:08.979 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:08.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:08.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:08.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:08.980 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:08 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:09.607 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:09.729 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:09.792 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6838/561076535,v1:10.20.193.126:6839/561076535] up:boot 2026-02-13T01:25:09.792 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: fsmap 12 up:standby 2026-02-13T01:25:09.792 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:25:09.792 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:09.793 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: Cluster is now healthy 2026-02-13T01:25:09.793 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:09.793 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:09 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6838/561076535,v1:10.20.193.126:6839/561076535] up:boot 2026-02-13T01:25:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: fsmap 12 up:standby 2026-02-13T01:25:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:25:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: Cluster is now healthy 2026-02-13T01:25:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:09.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:09 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:09.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 -- 10.20.193.91:0/3945177224 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 msgr2=0x7f4e9c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:09.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/3945177224 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c10f600 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=2796855128928070063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900099a0 tx=0x7f4e9002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:09.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 -- 10.20.193.91:0/3945177224 shutdown_connections 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/3945177224 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e9c115440 0x7f4e9c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/3945177224 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e9c10fc20 0x7f4e9c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/3945177224 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c10f600 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=2796855128928070063 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 -- 10.20.193.91:0/3945177224 >> 10.20.193.91:0/3945177224 conn(0x7f4e9c0ecb30 msgr2=0x7f4e9c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 -- 10.20.193.91:0/3945177224 shutdown_connections 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 -- 10.20.193.91:0/3945177224 wait complete. 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.857+0000 7f4ea18976c0 1 Processor -- start 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 -- start start 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c11d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e9c115440 0x7f4e9c11d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:09.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e9c122b30 0x7f4e9c122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c123510 con 0x7f4e9c10f230 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c123680 con 0x7f4e9c115440 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c123840 con 0x7f4e9c122b30 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c11d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c11d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50100/0 (socket says 10.20.193.91:50100) 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 -- 10.20.193.91:0/264026559 learned_addr learned my addr 10.20.193.91:0/264026559 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 -- 10.20.193.91:0/264026559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e9c122b30 msgr2=0x7f4e9c122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e9c122b30 0x7f4e9c122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 -- 10.20.193.91:0/264026559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e9c115440 msgr2=0x7f4e9c11d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e9c115440 0x7f4e9c11d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 -- 10.20.193.91:0/264026559 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e90009590 con 0x7f4e9c10f230 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4e9affd6c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c11d230 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900023e0 tx=0x7f4e9002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e90002ae0 con 0x7f4e9c10f230 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c163cc0 con 0x7f4e9c10f230 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4e90007680 con 0x7f4e9c10f230 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e90037500 con 0x7f4e9c10f230 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.858+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c164190 con 0x7f4e9c10f230 2026-02-13T01:25:09.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.859+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c110500 con 0x7f4e9c10f230 2026-02-13T01:25:09.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.860+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4e90002ce0 con 0x7f4e9c10f230 2026-02-13T01:25:09.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.860+0000 7f4ea08916c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4e700b5650 0x7f4e700d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:09.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.861+0000 7f4e9a7fc6c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4e700b5650 0x7f4e700d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:09.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.861+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f4e90107ab0 con 0x7f4e9c10f230 2026-02-13T01:25:09.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.861+0000 7f4e9a7fc6c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4e700b5650 0x7f4e700d5b00 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e84005980 tx=0x7f4e84005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:09.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.861+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4e900ca900 con 0x7f4e9c10f230 2026-02-13T01:25:09.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6838/561076535,v1:10.20.193.126:6839/561076535] up:boot 2026-02-13T01:25:09.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: fsmap 12 up:standby 2026-02-13T01:25:09.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T01:25:09.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T01:25:09.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: Cluster is now healthy 2026-02-13T01:25:09.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:09.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:09 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:25:09.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.979+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e9c11e3e0 con 0x7f4e9c10f230 2026-02-13T01:25:09.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.979+0000 7f4ea08916c0 1 -- 10.20.193.91:0/264026559 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10526 (secure 0 0 0) 0x7f4e900cdab0 con 0x7f4e9c10f230 2026-02-13T01:25:09.980 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:09.980 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":12,"btime":"2026-02-13T01:25:08:570755+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14745,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2335686987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2335686987},{"type":"v1","addr":"10.20.193.91:6835","nonce":2335686987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/1529166455","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":1529166455},{"type":"v1","addr":"10.20.193.91:6837","nonce":1529166455}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14793,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6839/330713711","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6838","nonce":330713711},{"type":"v1","addr":"10.20.193.91:6839","nonce":330713711}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6841/3913743624","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6840","nonce":3913743624},{"type":"v1","addr":"10.20.193.91:6841","nonce":3913743624}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24526,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6833/3628315638","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3628315638},{"type":"v1","addr":"10.20.193.154:6833","nonce":3628315638}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24562,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6835/2887274444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":2887274444},{"type":"v1","addr":"10.20.193.154:6835","nonce":2887274444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24568,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6837/1555539539","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":1555539539},{"type":"v1","addr":"10.20.193.154:6837","nonce":1555539539}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24575,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/2773810578","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":2773810578},{"type":"v1","addr":"10.20.193.126:6833","nonce":2773810578}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24577,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.154:6839/987021594","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6838","nonce":987021594},{"type":"v1","addr":"10.20.193.154:6839","nonce":987021594}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24593,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/1202805209","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":1202805209},{"type":"v1","addr":"10.20.193.126:6835","nonce":1202805209}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24611,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/223325597","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":223325597},{"type":"v1","addr":"10.20.193.126:6837","nonce":223325597}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6839/561076535","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":561076535},{"type":"v1","addr":"10.20.193.126:6839","nonce":561076535}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2026-02-13T01:25:09.980 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 12 2026-02-13T01:25:09.981 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4e700b5650 msgr2=0x7f4e700d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:09.981 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4e700b5650 0x7f4e700d5b00 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e84005980 tx=0x7f4e84005910 comp rx=0 tx=0).stop 2026-02-13T01:25:09.981 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 msgr2=0x7f4e9c11d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:09.981 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c11d230 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900023e0 tx=0x7f4e9002fbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 shutdown_connections 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4e700b5650 0x7f4e700d5b00 unknown :-1 s=CLOSED pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e9c122b30 0x7f4e9c122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e9c115440 0x7f4e9c11d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 --2- 10.20.193.91:0/264026559 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e9c10f230 0x7f4e9c11d230 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 >> 10.20.193.91:0/264026559 conn(0x7f4e9c0ecb30 msgr2=0x7f4e9c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 shutdown_connections 2026-02-13T01:25:09.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:09.981+0000 7f4ea18976c0 1 -- 10.20.193.91:0/264026559 wait complete. 2026-02-13T01:25:10.025 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T01:25:10.143 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:10.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 -- 10.20.193.91:0/1711577505 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810d970 msgr2=0x7fc8b81129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/1711577505 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810d970 0x7fc8b81129b0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=15714320849704636731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a00099a0 tx=0x7fc8a002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 -- 10.20.193.91:0/1711577505 shutdown_connections 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/1711577505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 0x7fc8b8173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/1711577505 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810d970 0x7fc8b81129b0 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=15714320849704636731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/1711577505 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc8b810cf80 0x7fc8b810d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 -- 10.20.193.91:0/1711577505 >> 10.20.193.91:0/1711577505 conn(0x7fc8b80ea880 msgr2=0x7fc8b810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 -- 10.20.193.91:0/1711577505 shutdown_connections 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 -- 10.20.193.91:0/1711577505 wait complete. 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 Processor -- start 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.266+0000 7fc8bec336c0 1 -- start start 2026-02-13T01:25:10.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 0x7fc8b811b0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 0x7fc8b811b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc8b81209a0 0x7fc8b8120e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b81213b0 con 0x7fc8b810cf80 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8121520 con 0x7fc8b8113190 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b81216e0 con 0x7fc8b81209a0 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 0x7fc8b811b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 0x7fc8b811b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50108/0 (socket says 10.20.193.91:50108) 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 -- 10.20.193.91:0/3995350657 learned_addr learned my addr 10.20.193.91:0/3995350657 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8affff6c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 0x7fc8b811b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bd1a56c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc8b81209a0 0x7fc8b8120e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 -- 10.20.193.91:0/3995350657 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc8b81209a0 msgr2=0x7fc8b8120e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc8b81209a0 0x7fc8b8120e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 -- 10.20.193.91:0/3995350657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 msgr2=0x7fc8b811b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 0x7fc8b811b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 -- 10.20.193.91:0/3995350657 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a0009590 con 0x7fc8b810cf80 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8affff6c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 0x7fc8b811b5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bc9a46c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 0x7fc8b811b0a0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a8005dc0 tx=0x7fc8a800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a8004250 con 0x7fc8b810cf80 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b8161b90 con 0x7fc8b810cf80 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc8a8009070 con 0x7fc8b810cf80 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a800cd70 con 0x7fc8b810cf80 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b8162020 con 0x7fc8b810cf80 2026-02-13T01:25:10.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.267+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b810e250 con 0x7fc8b810cf80 2026-02-13T01:25:10.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.269+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fc8a80028c0 con 0x7fc8b810cf80 2026-02-13T01:25:10.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.269+0000 7fc8adffb6c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8940b5650 0x7fc8940d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.270+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fc8a80e3800 con 0x7fc8b810cf80 2026-02-13T01:25:10.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.270+0000 7fc8affff6c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8940b5650 0x7fc8940d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.270+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8a80a9620 con 0x7fc8b810cf80 2026-02-13T01:25:10.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.270+0000 7fc8affff6c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8940b5650 0x7fc8940d5b00 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b8121a30 tx=0x7fc8a00023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:10.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.360+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc8b811c220 con 0x7fc8b810cf80 2026-02-13T01:25:10.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.360+0000 7fc8adffb6c0 1 -- 10.20.193.91:0/3995350657 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fc8a80a9800 con 0x7fc8b810cf80 2026-02-13T01:25:10.361 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:10.361 INFO:teuthology.orchestra.run.trial091.stdout:[ 2026-02-13T01:25:10.361 INFO:teuthology.orchestra.run.trial091.stdout: { 2026-02-13T01:25:10.361 INFO:teuthology.orchestra.run.trial091.stdout: "poolnum": 1, 2026-02-13T01:25:10.362 INFO:teuthology.orchestra.run.trial091.stdout: "poolname": ".mgr" 2026-02-13T01:25:10.362 INFO:teuthology.orchestra.run.trial091.stdout: } 2026-02-13T01:25:10.362 INFO:teuthology.orchestra.run.trial091.stdout:] 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8940b5650 msgr2=0x7fc8940d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8940b5650 0x7fc8940d5b00 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8b8121a30 tx=0x7fc8a00023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 msgr2=0x7fc8b811b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 0x7fc8b811b0a0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a8005dc0 tx=0x7fc8a800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 shutdown_connections 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8940b5650 0x7fc8940d5b00 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc8b81209a0 0x7fc8b8120e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8b8113190 0x7fc8b811b5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 --2- 10.20.193.91:0/3995350657 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc8b810cf80 0x7fc8b811b0a0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 >> 10.20.193.91:0/3995350657 conn(0x7fc8b80ea880 msgr2=0x7fc8b810ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:10.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 shutdown_connections 2026-02-13T01:25:10.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.361+0000 7fc8bec336c0 1 -- 10.20.193.91:0/3995350657 wait complete. 2026-02-13T01:25:10.401 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T01:25:10.401 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T01:25:10.517 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:10.633 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.634 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:10.634 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:10.634 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:10.634 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.634 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/264026559' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:10.634 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:10 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3995350657' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:25:10.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 -- 10.20.193.91:0/345719184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f162810fbf0 msgr2=0x7f1628114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 --2- 10.20.193.91:0/345719184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f162810fbf0 0x7f1628114c30 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=7120326722166088641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16100099a0 tx=0x7f161002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:10.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 -- 10.20.193.91:0/345719184 shutdown_connections 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 --2- 10.20.193.91:0/345719184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1628115410 0x7f1628175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 --2- 10.20.193.91:0/345719184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f162810fbf0 0x7f1628114c30 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=7120326722166088641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 --2- 10.20.193.91:0/345719184 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f162810f200 0x7f162810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 -- 10.20.193.91:0/345719184 >> 10.20.193.91:0/345719184 conn(0x7f16280ecb00 msgr2=0x7f162810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 -- 10.20.193.91:0/345719184 shutdown_connections 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 -- 10.20.193.91:0/345719184 wait complete. 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 Processor -- start 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.635+0000 7f162ee246c0 1 -- start start 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f162810f200 0x7f16280f4d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1628115410 0x7f1628175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 0x7f16280fa650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f16280f5a70 con 0x7f16280f5380 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f16280fab90 con 0x7f1628115410 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16280fad50 con 0x7f162810f200 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 0x7f16280fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 0x7f16280fa650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50128/0 (socket says 10.20.193.91:50128) 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 -- 10.20.193.91:0/3516069327 learned_addr learned my addr 10.20.193.91:0/3516069327 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162cb956c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f162810f200 0x7f16280f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f161ffff6c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1628115410 0x7f1628175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 -- 10.20.193.91:0/3516069327 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f162810f200 msgr2=0x7f16280f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f162810f200 0x7f16280f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 -- 10.20.193.91:0/3516069327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1628115410 msgr2=0x7f1628175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:10.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1628115410 0x7f1628175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 -- 10.20.193.91:0/3516069327 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1610009590 con 0x7f16280f5380 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162d3966c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 0x7f16280fa650 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1624006ea0 tx=0x7f162400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1624003a30 con 0x7f16280f5380 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f16240054f0 con 0x7f16280f5380 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f162400dcd0 con 0x7f16280f5380 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16280fb030 con 0x7f16280f5380 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16280fb4c0 con 0x7f16280f5380 2026-02-13T01:25:10.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.636+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16281104d0 con 0x7f16280f5380 2026-02-13T01:25:10.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.638+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f1624003b90 con 0x7f16280f5380 2026-02-13T01:25:10.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.639+0000 7f161dffb6c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16040b56d0 0x7f16040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:10.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.639+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f16240e4470 con 0x7f16280f5380 2026-02-13T01:25:10.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.639+0000 7f162cb956c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16040b56d0 0x7f16040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:10.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.639+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f16240e4960 con 0x7f16280f5380 2026-02-13T01:25:10.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.639+0000 7f162cb956c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16040b56d0 0x7f16040d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1618004750 tx=0x7f1618009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:10.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:10.729+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f16280fb4c0 con 0x7f16280f5380 2026-02-13T01:25:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/264026559' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:10.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:10 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3995350657' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:25:10.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:25:10.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:25:10.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:25:10.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/264026559' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:10.967 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:10 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3995350657' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T01:25:11.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.576+0000 7f161dffb6c0 1 -- 10.20.193.91:0/3516069327 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f16240a72c0 con 0x7f16280f5380 2026-02-13T01:25:11.577 INFO:teuthology.orchestra.run.trial091.stderr:pool 'cephfs_metadata' created 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16040b56d0 msgr2=0x7f16040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16040b56d0 0x7f16040d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1618004750 tx=0x7f1618009390 comp rx=0 tx=0).stop 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 msgr2=0x7f16280fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 0x7f16280fa650 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1624006ea0 tx=0x7f162400cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 shutdown_connections 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16040b56d0 0x7f16040d5b80 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f16280f5380 0x7f16280fa650 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1628115410 0x7f1628175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 --2- 10.20.193.91:0/3516069327 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f162810f200 0x7f16280f4d50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 >> 10.20.193.91:0/3516069327 conn(0x7f16280ecb00 msgr2=0x7f1628111c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:11.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 shutdown_connections 2026-02-13T01:25:11.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.578+0000 7f162ee246c0 1 -- 10.20.193.91:0/3516069327 wait complete. 2026-02-13T01:25:11.620 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T01:25:11.737 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:11 trial126 ceph-mon[26569]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:11 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3516069327' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:11 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:11.852 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:11 trial091 ceph-mon[25068]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:11.852 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:11 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3516069327' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:11.852 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:11 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/3820176438 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb010f200 msgr2=0x7f8cb010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/3820176438 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb010f200 0x7f8cb010f5d0 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=16067748494169339511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ca00099a0 tx=0x7f8ca002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/3820176438 shutdown_connections 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/3820176438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0115410 0x7f8cb0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/3820176438 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8cb010fbf0 0x7f8cb0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/3820176438 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb010f200 0x7f8cb010f5d0 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=16067748494169339511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/3820176438 >> 10.20.193.91:0/3820176438 conn(0x7f8cb00ecb00 msgr2=0x7f8cb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/3820176438 shutdown_connections 2026-02-13T01:25:11.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.857+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/3820176438 wait complete. 2026-02-13T01:25:11.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 Processor -- start 2026-02-13T01:25:11.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 -- start start 2026-02-13T01:25:11.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8cb010f200 0x7f8cb011d2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 0x7f8cb011d820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0122be0 0x7f8cb0123080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb01235f0 con 0x7f8cb0115410 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0123760 con 0x7f8cb0122be0 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb0123920 con 0x7f8cb010f200 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 0x7f8cb011d820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 0x7f8cb011d820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50152/0 (socket says 10.20.193.91:50152) 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 -- 10.20.193.91:0/2169062446 learned_addr learned my addr 10.20.193.91:0/2169062446 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb4b916c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8cb010f200 0x7f8cb011d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb53926c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0122be0 0x7f8cb0123080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:11.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 -- 10.20.193.91:0/2169062446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8cb010f200 msgr2=0x7f8cb011d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8cb010f200 0x7f8cb011d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 -- 10.20.193.91:0/2169062446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0122be0 msgr2=0x7f8cb0123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0122be0 0x7f8cb0123080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 -- 10.20.193.91:0/2169062446 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca0009590 con 0x7f8cb0115410 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb53926c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0122be0 0x7f8cb0123080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca7fff6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 0x7f8cb011d820 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c98005dc0 tx=0x7f8c9800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c98004250 con 0x7f8cb0115410 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8c98009070 con 0x7f8cb0115410 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb0163dd0 con 0x7f8cb0115410 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c9800cd50 con 0x7f8cb0115410 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.858+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb0164260 con 0x7f8cb0115410 2026-02-13T01:25:11.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.860+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb01104d0 con 0x7f8cb0115410 2026-02-13T01:25:11.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.860+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f8c980028c0 con 0x7f8cb0115410 2026-02-13T01:25:11.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.861+0000 7f8ca5ffb6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c8c0b5650 0x7f8c8c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:11.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.861+0000 7f8cb4b916c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c8c0b5650 0x7f8c8c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:11.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.861+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7492+0+0 (secure 0 0 0) 0x7f8c980e38c0 con 0x7f8cb0115410 2026-02-13T01:25:11.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.861+0000 7f8cb4b916c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c8c0b5650 0x7f8c8c0d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ca0005b40 tx=0x7f8ca00023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:11.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.861+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8c980a6550 con 0x7f8cb0115410 2026-02-13T01:25:11.952 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:11.952+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8cb010f5d0 con 0x7f8cb0115410 2026-02-13T01:25:11.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:11 trial154 ceph-mon[27045]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:11.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:11 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3516069327' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T01:25:11.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:11 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:25:12.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.579+0000 7f8ca5ffb6c0 1 -- 10.20.193.91:0/2169062446 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f8c980a9700 con 0x7f8cb0115410 2026-02-13T01:25:12.579 INFO:teuthology.orchestra.run.trial091.stderr:pool 'cephfs_data' created 2026-02-13T01:25:12.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c8c0b5650 msgr2=0x7f8c8c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c8c0b5650 0x7f8c8c0d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ca0005b40 tx=0x7f8ca00023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 msgr2=0x7f8cb011d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 0x7f8cb011d820 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c98005dc0 tx=0x7f8c9800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 shutdown_connections 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c8c0b5650 0x7f8c8c0d5b00 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cb0122be0 0x7f8cb0123080 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8cb0115410 0x7f8cb011d820 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 --2- 10.20.193.91:0/2169062446 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8cb010f200 0x7f8cb011d2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 >> 10.20.193.91:0/2169062446 conn(0x7f8cb00ecb00 msgr2=0x7f8cb010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 shutdown_connections 2026-02-13T01:25:12.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.582+0000 7f8cb6e1c6c0 1 -- 10.20.193.91:0/2169062446 wait complete. 2026-02-13T01:25:12.628 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T01:25:12.743 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:12 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3516069327' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:25:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:12 trial126 ceph-mon[26569]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:25:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:12 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2169062446' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:25:12.858 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:12 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3516069327' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:25:12.858 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:12 trial091 ceph-mon[25068]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:25:12.859 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:12 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2169062446' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:25:12.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 -- 10.20.193.91:0/3670414447 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010d9a0 msgr2=0x7fc9901129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/3670414447 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010d9a0 0x7fc9901129e0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=10838983492648149804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9840099a0 tx=0x7fc98402ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 -- 10.20.193.91:0/3670414447 shutdown_connections 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/3670414447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9901131c0 0x7fc990173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/3670414447 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010d9a0 0x7fc9901129e0 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=10838983492648149804 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/3670414447 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc99010cfb0 0x7fc99010d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 -- 10.20.193.91:0/3670414447 >> 10.20.193.91:0/3670414447 conn(0x7fc9900ea8b0 msgr2=0x7fc99010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 -- 10.20.193.91:0/3670414447 shutdown_connections 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.862+0000 7fc9985a86c0 1 -- 10.20.193.91:0/3670414447 wait complete. 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 Processor -- start 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 -- start start 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 0x7fc9900f2ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc9901131c0 0x7fc990173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9900f3110 0x7fc9900f83e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc9900f3770 con 0x7fc99010cfb0 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc9900f8920 con 0x7fc9900f3110 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9900f8ae0 con 0x7fc9901131c0 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 0x7fc9900f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 0x7fc9900f2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50174/0 (socket says 10.20.193.91:50174) 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 -- 10.20.193.91:0/1080358589 learned_addr learned my addr 10.20.193.91:0/1080358589 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc995b186c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc9901131c0 0x7fc990173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc996b1a6c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9900f3110 0x7fc9900f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 -- 10.20.193.91:0/1080358589 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc9901131c0 msgr2=0x7fc990173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc9901131c0 0x7fc990173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 -- 10.20.193.91:0/1080358589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9900f3110 msgr2=0x7fc9900f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9900f3110 0x7fc9900f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 -- 10.20.193.91:0/1080358589 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc984009590 con 0x7fc99010cfb0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc996b1a6c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9900f3110 0x7fc9900f83e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9963196c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 0x7fc9900f2ae0 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc98000b6c0 tx=0x7fc98000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc980004560 con 0x7fc99010cfb0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc980009030 con 0x7fc99010cfb0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc98000cd90 con 0x7fc99010cfb0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9900f8d60 con 0x7fc99010cfb0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.863+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9900f91f0 con 0x7fc99010cfb0 2026-02-13T01:25:12.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.864+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99010e280 con 0x7fc99010cfb0 2026-02-13T01:25:12.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.865+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fc9800026b0 con 0x7fc99010cfb0 2026-02-13T01:25:12.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.866+0000 7fc9777fe6c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc96c0b56d0 0x7fc96c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:12.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.866+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7877+0+0 (secure 0 0 0) 0x7fc9800e38c0 con 0x7fc99010cfb0 2026-02-13T01:25:12.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.866+0000 7fc995b186c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc96c0b56d0 0x7fc96c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:12.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.866+0000 7fc995b186c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc96c0b56d0 0x7fc96c0d5b80 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9840023e0 tx=0x7fc984009280 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:12.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.866+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc9800a6410 con 0x7fc99010cfb0 2026-02-13T01:25:12.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:12 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3516069327' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T01:25:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:12 trial154 ceph-mon[27045]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T01:25:12.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:12 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2169062446' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T01:25:12.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:12.983+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc99010d380 con 0x7fc99010cfb0 2026-02-13T01:25:13.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.587+0000 7fc9777fe6c0 1 -- 10.20.193.91:0/1080358589 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7fc9800a95c0 con 0x7fc99010cfb0 2026-02-13T01:25:13.587 INFO:teuthology.orchestra.run.trial091.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T01:25:13.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc96c0b56d0 msgr2=0x7fc96c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc96c0b56d0 0x7fc96c0d5b80 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9840023e0 tx=0x7fc984009280 comp rx=0 tx=0).stop 2026-02-13T01:25:13.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 msgr2=0x7fc9900f2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 0x7fc9900f2ae0 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc98000b6c0 tx=0x7fc98000bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:13.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 shutdown_connections 2026-02-13T01:25:13.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc96c0b56d0 0x7fc96c0d5b80 unknown :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9900f3110 0x7fc9900f83e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc9901131c0 0x7fc990173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 --2- 10.20.193.91:0/1080358589 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc99010cfb0 0x7fc9900f2ae0 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 >> 10.20.193.91:0/1080358589 conn(0x7fc9900ea8b0 msgr2=0x7fc99010b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:13.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 shutdown_connections 2026-02-13T01:25:13.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.590+0000 7fc9985a86c0 1 -- 10.20.193.91:0/1080358589 wait complete. 2026-02-13T01:25:13.634 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:13.752 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:13 trial126 ceph-mon[26569]: pgmap v173: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:13 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2169062446' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:25:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:13 trial126 ceph-mon[26569]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:25:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:13 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1080358589' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:13.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:13 trial126 ceph-mon[26569]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- 10.20.193.91:0/1360921524 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c10cfb0 msgr2=0x7eff1c10d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/1360921524 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c10cfb0 0x7eff1c10d380 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=13790055957064218731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff080099a0 tx=0x7eff0802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- 10.20.193.91:0/1360921524 shutdown_connections 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/1360921524 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7eff1c1131c0 0x7eff1c173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/1360921524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff1c10d9a0 0x7eff1c1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/1360921524 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c10cfb0 0x7eff1c10d380 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=13790055957064218731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- 10.20.193.91:0/1360921524 >> 10.20.193.91:0/1360921524 conn(0x7eff1c0ea8b0 msgr2=0x7eff1c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- 10.20.193.91:0/1360921524 shutdown_connections 2026-02-13T01:25:13.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- 10.20.193.91:0/1360921524 wait complete. 2026-02-13T01:25:13.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:13 trial091 ceph-mon[25068]: pgmap v173: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:13.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:13 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2169062446' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:25:13.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:13 trial091 ceph-mon[25068]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:25:13.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:13 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1080358589' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:13.868 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:13 trial091 ceph-mon[25068]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T01:25:13.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 Processor -- start 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- start start 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff1c10cfb0 0x7eff1c0f4ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7eff1c1131c0 0x7eff1c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 0x7eff1c0fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0f59c0 con 0x7eff1c0f52d0 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0faae0 con 0x7eff1c10cfb0 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.867+0000 7eff2238c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c0faca0 con 0x7eff1c1131c0 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 0x7eff1c0fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 0x7eff1c0fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50188/0 (socket says 10.20.193.91:50188) 2026-02-13T01:25:13.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 -- 10.20.193.91:0/622976018 learned_addr learned my addr 10.20.193.91:0/622976018 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff1bfff6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff1c10cfb0 0x7eff1c0f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff1b7fe6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7eff1c1131c0 0x7eff1c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 -- 10.20.193.91:0/622976018 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7eff1c1131c0 msgr2=0x7eff1c173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7eff1c1131c0 0x7eff1c173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 -- 10.20.193.91:0/622976018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff1c10cfb0 msgr2=0x7eff1c0f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff1c10cfb0 0x7eff1c0f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 -- 10.20.193.91:0/622976018 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff08009590 con 0x7eff1c0f52d0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff208fe6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 0x7eff1c0fa5a0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff10006ea0 tx=0x7eff1000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff10003a30 con 0x7eff1c0f52d0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c0faf80 con 0x7eff1c0f52d0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7eff100054f0 con 0x7eff1c0f52d0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff1000dcd0 con 0x7eff1c0f52d0 2026-02-13T01:25:13.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c0fb710 con 0x7eff1c0f52d0 2026-02-13T01:25:13.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.868+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c0fb460 con 0x7eff1c0f52d0 2026-02-13T01:25:13.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.870+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7eff10003b90 con 0x7eff1c0f52d0 2026-02-13T01:25:13.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.870+0000 7eff197fa6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efef00b5650 0x7efef00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:13.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.871+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7eff100e4aa0 con 0x7eff1c0f52d0 2026-02-13T01:25:13.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.871+0000 7eff1bfff6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efef00b5650 0x7efef00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:13.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.871+0000 7eff1bfff6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efef00b5650 0x7efef00d5b00 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff08005b40 tx=0x7eff080023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:13.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.872+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7eff100a7550 con 0x7eff1c0f52d0 2026-02-13T01:25:13.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.962+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff1c10e280 con 0x7eff1c0f52d0 2026-02-13T01:25:13.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.963+0000 7eff197fa6c0 1 -- 10.20.193.91:0/622976018 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22389 (secure 0 0 0) 0x7eff1000de60 con 0x7eff1c0f52d0 2026-02-13T01:25:13.963 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:13.963 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":74,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","created":"2026-02-13T01:22:42.667442+0000","modified":"2026-02-13T01:25:12.984157+0000","last_up_change":"2026-02-13T01:24:55.419630+0000","last_in_change":"2026-02-13T01:24:47.172971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:51.498651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:10.736175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:11.959007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1ffbd7ff-7a87-4947-8ce2-ad23813a7754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6803","nonce":170892896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6805","nonce":170892896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6809","nonce":170892896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6807","nonce":170892896}]},"public_addr":"10.20.193.91:6803/170892896","cluster_addr":"10.20.193.91:6805/170892896","heartbeat_back_addr":"10.20.193.91:6809/170892896","heartbeat_front_addr":"10.20.193.91:6807/170892896","state":["exists","up"]},{"osd":1,"uuid":"5d698ba3-8a17-455c-b05d-8ca1c9d44466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6801","nonce":1754332231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6803","nonce":1754332231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6807","nonce":1754332231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6805","nonce":1754332231}]},"public_addr":"10.20.193.126:6801/1754332231","cluster_addr":"10.20.193.126:6803/1754332231","heartbeat_back_addr":"10.20.193.126:6807/1754332231","heartbeat_front_addr":"10.20.193.126:6805/1754332231","state":["exists","up"]},{"osd":2,"uuid":"4b9d9a44-7956-4117-ada8-cb99016ae048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6801","nonce":1701976259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6803","nonce":1701976259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6807","nonce":1701976259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6805","nonce":1701976259}]},"public_addr":"10.20.193.154:6801/1701976259","cluster_addr":"10.20.193.154:6803/1701976259","heartbeat_back_addr":"10.20.193.154:6807/1701976259","heartbeat_front_addr":"10.20.193.154:6805/1701976259","state":["exists","up"]},{"osd":3,"uuid":"bb667b65-2ce1-4131-88de-53efa7c8fb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6811","nonce":746110270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6813","nonce":746110270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6817","nonce":746110270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6815","nonce":746110270}]},"public_addr":"10.20.193.91:6811/746110270","cluster_addr":"10.20.193.91:6813/746110270","heartbeat_back_addr":"10.20.193.91:6817/746110270","heartbeat_front_addr":"10.20.193.91:6815/746110270","state":["exists","up"]},{"osd":4,"uuid":"a2569ae9-0cac-4935-94f5-bfcbd0376cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6809","nonce":2328526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6811","nonce":2328526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6815","nonce":2328526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6813","nonce":2328526761}]},"public_addr":"10.20.193.126:6809/2328526761","cluster_addr":"10.20.193.126:6811/2328526761","heartbeat_back_addr":"10.20.193.126:6815/2328526761","heartbeat_front_addr":"10.20.193.126:6813/2328526761","state":["exists","up"]},{"osd":5,"uuid":"6279cc06-cf48-430f-929b-fde87b33e114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6809","nonce":2892893681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6811","nonce":2892893681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6815","nonce":2892893681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6813","nonce":2892893681}]},"public_addr":"10.20.193.154:6809/2892893681","cluster_addr":"10.20.193.154:6811/2892893681","heartbeat_back_addr":"10.20.193.154:6815/2892893681","heartbeat_front_addr":"10.20.193.154:6813/2892893681","state":["exists","up"]},{"osd":6,"uuid":"47579bf9-6170-4408-810f-8be850659d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6819","nonce":1887880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6821","nonce":1887880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6825","nonce":1887880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6823","nonce":1887880552}]},"public_addr":"10.20.193.91:6819/1887880552","cluster_addr":"10.20.193.91:6821/1887880552","heartbeat_back_addr":"10.20.193.91:6825/1887880552","heartbeat_front_addr":"10.20.193.91:6823/1887880552","state":["exists","up"]},{"osd":7,"uuid":"5ec7f6c4-8479-4e14-855e-fa3b594f058c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6817","nonce":1270299623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6819","nonce":1270299623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6823","nonce":1270299623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6821","nonce":1270299623}]},"public_addr":"10.20.193.126:6817/1270299623","cluster_addr":"10.20.193.126:6819/1270299623","heartbeat_back_addr":"10.20.193.126:6823/1270299623","heartbeat_front_addr":"10.20.193.126:6821/1270299623","state":["exists","up"]},{"osd":8,"uuid":"19fbc479-f0bf-46d3-9d48-648388632fb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6817","nonce":1364755569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6819","nonce":1364755569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6823","nonce":1364755569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6821","nonce":1364755569}]},"public_addr":"10.20.193.154:6817/1364755569","cluster_addr":"10.20.193.154:6819/1364755569","heartbeat_back_addr":"10.20.193.154:6823/1364755569","heartbeat_front_addr":"10.20.193.154:6821/1364755569","state":["exists","up"]},{"osd":9,"uuid":"a3befdc3-c847-4659-9ec1-0dd5e3172fe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6827","nonce":1541303371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6829","nonce":1541303371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6833","nonce":1541303371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6831","nonce":1541303371}]},"public_addr":"10.20.193.91:6827/1541303371","cluster_addr":"10.20.193.91:6829/1541303371","heartbeat_back_addr":"10.20.193.91:6833/1541303371","heartbeat_front_addr":"10.20.193.91:6831/1541303371","state":["exists","up"]},{"osd":10,"uuid":"36fe781f-9334-474b-bc6b-01e798e72a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6825","nonce":3309349280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6827","nonce":3309349280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6831","nonce":3309349280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6829","nonce":3309349280}]},"public_addr":"10.20.193.126:6825/3309349280","cluster_addr":"10.20.193.126:6827/3309349280","heartbeat_back_addr":"10.20.193.126:6831/3309349280","heartbeat_front_addr":"10.20.193.126:6829/3309349280","state":["exists","up"]},{"osd":11,"uuid":"5f569e12-4d88-4cf0-8f2e-147ace91f917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6825","nonce":1394532940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6827","nonce":1394532940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6831","nonce":1394532940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6829","nonce":1394532940}]},"public_addr":"10.20.193.154:6825/1394532940","cluster_addr":"10.20.193.154:6827/1394532940","heartbeat_back_addr":"10.20.193.154:6831/1394532940","heartbeat_front_addr":"10.20.193.154:6829/1394532940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:34.061683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.894443+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:47.963906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.184288+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:02.378327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:09.561223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:16.947535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:24.187301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.493620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:38.824765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.268089+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:53.733044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.91:6801/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/624457179":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/335308306":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/2950715894":"2026-02-14T01:22:48.728580+0000","10.20.193.91:6801/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/3747672627":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/2063745168":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/1509443464":"2026-02-14T01:22:48.728580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:13.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efef00b5650 msgr2=0x7efef00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efef00b5650 0x7efef00d5b00 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff08005b40 tx=0x7eff080023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 msgr2=0x7eff1c0fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 0x7eff1c0fa5a0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff10006ea0 tx=0x7eff1000cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 shutdown_connections 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efef00b5650 0x7efef00d5b00 unknown :-1 s=CLOSED pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7eff1c0f52d0 0x7eff1c0fa5a0 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7eff1c1131c0 0x7eff1c173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 --2- 10.20.193.91:0/622976018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff1c10cfb0 0x7eff1c0f4ca0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 >> 10.20.193.91:0/622976018 conn(0x7eff1c0ea8b0 msgr2=0x7eff1c10b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 shutdown_connections 2026-02-13T01:25:13.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:13.964+0000 7eff2238c6c0 1 -- 10.20.193.91:0/622976018 wait complete. 2026-02-13T01:25:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:13 trial154 ceph-mon[27045]: pgmap v173: 33 pgs: 2 creating+peering, 30 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T01:25:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:13 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2169062446' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T01:25:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:13 trial154 ceph-mon[27045]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T01:25:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:13 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1080358589' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T01:25:13.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:13 trial154 ceph-mon[27045]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T01:25:14.004 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:14.120 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:14.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1703370277 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 msgr2=0x7f9fe810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1703370277 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe810f600 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=14181727483608567026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd80099a0 tx=0x7f9fd802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:14.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1703370277 shutdown_connections 2026-02-13T01:25:14.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1703370277 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fe8115440 0x7f9fe8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1703370277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9fe810fc20 0x7f9fe8114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1703370277 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe810f600 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=14181727483608567026 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1703370277 >> 10.20.193.91:0/1703370277 conn(0x7f9fe80ecb30 msgr2=0x7f9fe810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1703370277 shutdown_connections 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1703370277 wait complete. 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 Processor -- start 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.232+0000 7f9feeed16c0 1 -- start start 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe811d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9fe8115440 0x7f9fe811d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fe8122c80 0x7f9fe8123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8123690 con 0x7f9fe810f230 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe8123800 con 0x7f9fe8115440 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe81239c0 con 0x7f9fe8122c80 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe811d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe811d380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50204/0 (socket says 10.20.193.91:50204) 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 -- 10.20.193.91:0/1413837639 learned_addr learned my addr 10.20.193.91:0/1413837639 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fdffff6c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9fe8115440 0x7f9fe811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 -- 10.20.193.91:0/1413837639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fe8122c80 msgr2=0x7f9fe8123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fe8122c80 0x7f9fe8123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 -- 10.20.193.91:0/1413837639 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9fe8115440 msgr2=0x7f9fe811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9fe8115440 0x7f9fe811d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 -- 10.20.193.91:0/1413837639 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd8009590 con 0x7f9fe810f230 2026-02-13T01:25:14.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fecc426c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe811d380 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd802f230 tx=0x7f9fd802fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fd8002ae0 con 0x7f9fe810f230 2026-02-13T01:25:14.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe8163e10 con 0x7f9fe810f230 2026-02-13T01:25:14.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9fd8002c40 con 0x7f9fe810f230 2026-02-13T01:25:14.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9fd80372f0 con 0x7f9fe810f230 2026-02-13T01:25:14.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe8164290 con 0x7f9fe810f230 2026-02-13T01:25:14.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.233+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe8110500 con 0x7f9fe810f230 2026-02-13T01:25:14.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.235+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f9fd8007810 con 0x7f9fe810f230 2026-02-13T01:25:14.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.236+0000 7f9fddffb6c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9fc40b56d0 0x7f9fc40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.236+0000 7f9fdffff6c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9fc40b56d0 0x7f9fc40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.236+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f9fd8107c80 con 0x7f9fe810f230 2026-02-13T01:25:14.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.236+0000 7f9fdffff6c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9fc40b56d0 0x7f9fc40d5b80 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fe8123d10 tx=0x7f9fd0009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.236+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9fd80ce190 con 0x7f9fe810f230 2026-02-13T01:25:14.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.327+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fe810fc20 con 0x7f9fe810f230 2026-02-13T01:25:14.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.328+0000 7f9fddffb6c0 1 -- 10.20.193.91:0/1413837639 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22389 (secure 0 0 0) 0x7f9fd80cd8e0 con 0x7f9fe810f230 2026-02-13T01:25:14.328 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:14.328 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":74,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","created":"2026-02-13T01:22:42.667442+0000","modified":"2026-02-13T01:25:12.984157+0000","last_up_change":"2026-02-13T01:24:55.419630+0000","last_in_change":"2026-02-13T01:24:47.172971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:51.498651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:10.736175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:11.959007+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1ffbd7ff-7a87-4947-8ce2-ad23813a7754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6803","nonce":170892896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6805","nonce":170892896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6809","nonce":170892896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6807","nonce":170892896}]},"public_addr":"10.20.193.91:6803/170892896","cluster_addr":"10.20.193.91:6805/170892896","heartbeat_back_addr":"10.20.193.91:6809/170892896","heartbeat_front_addr":"10.20.193.91:6807/170892896","state":["exists","up"]},{"osd":1,"uuid":"5d698ba3-8a17-455c-b05d-8ca1c9d44466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6801","nonce":1754332231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6803","nonce":1754332231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6807","nonce":1754332231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6805","nonce":1754332231}]},"public_addr":"10.20.193.126:6801/1754332231","cluster_addr":"10.20.193.126:6803/1754332231","heartbeat_back_addr":"10.20.193.126:6807/1754332231","heartbeat_front_addr":"10.20.193.126:6805/1754332231","state":["exists","up"]},{"osd":2,"uuid":"4b9d9a44-7956-4117-ada8-cb99016ae048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6801","nonce":1701976259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6803","nonce":1701976259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6807","nonce":1701976259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6805","nonce":1701976259}]},"public_addr":"10.20.193.154:6801/1701976259","cluster_addr":"10.20.193.154:6803/1701976259","heartbeat_back_addr":"10.20.193.154:6807/1701976259","heartbeat_front_addr":"10.20.193.154:6805/1701976259","state":["exists","up"]},{"osd":3,"uuid":"bb667b65-2ce1-4131-88de-53efa7c8fb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6811","nonce":746110270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6813","nonce":746110270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6817","nonce":746110270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6815","nonce":746110270}]},"public_addr":"10.20.193.91:6811/746110270","cluster_addr":"10.20.193.91:6813/746110270","heartbeat_back_addr":"10.20.193.91:6817/746110270","heartbeat_front_addr":"10.20.193.91:6815/746110270","state":["exists","up"]},{"osd":4,"uuid":"a2569ae9-0cac-4935-94f5-bfcbd0376cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6809","nonce":2328526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6811","nonce":2328526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6815","nonce":2328526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6813","nonce":2328526761}]},"public_addr":"10.20.193.126:6809/2328526761","cluster_addr":"10.20.193.126:6811/2328526761","heartbeat_back_addr":"10.20.193.126:6815/2328526761","heartbeat_front_addr":"10.20.193.126:6813/2328526761","state":["exists","up"]},{"osd":5,"uuid":"6279cc06-cf48-430f-929b-fde87b33e114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6809","nonce":2892893681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6811","nonce":2892893681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6815","nonce":2892893681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6813","nonce":2892893681}]},"public_addr":"10.20.193.154:6809/2892893681","cluster_addr":"10.20.193.154:6811/2892893681","heartbeat_back_addr":"10.20.193.154:6815/2892893681","heartbeat_front_addr":"10.20.193.154:6813/2892893681","state":["exists","up"]},{"osd":6,"uuid":"47579bf9-6170-4408-810f-8be850659d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6819","nonce":1887880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6821","nonce":1887880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6825","nonce":1887880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6823","nonce":1887880552}]},"public_addr":"10.20.193.91:6819/1887880552","cluster_addr":"10.20.193.91:6821/1887880552","heartbeat_back_addr":"10.20.193.91:6825/1887880552","heartbeat_front_addr":"10.20.193.91:6823/1887880552","state":["exists","up"]},{"osd":7,"uuid":"5ec7f6c4-8479-4e14-855e-fa3b594f058c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6817","nonce":1270299623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6819","nonce":1270299623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6823","nonce":1270299623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6821","nonce":1270299623}]},"public_addr":"10.20.193.126:6817/1270299623","cluster_addr":"10.20.193.126:6819/1270299623","heartbeat_back_addr":"10.20.193.126:6823/1270299623","heartbeat_front_addr":"10.20.193.126:6821/1270299623","state":["exists","up"]},{"osd":8,"uuid":"19fbc479-f0bf-46d3-9d48-648388632fb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6817","nonce":1364755569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6819","nonce":1364755569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6823","nonce":1364755569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6821","nonce":1364755569}]},"public_addr":"10.20.193.154:6817/1364755569","cluster_addr":"10.20.193.154:6819/1364755569","heartbeat_back_addr":"10.20.193.154:6823/1364755569","heartbeat_front_addr":"10.20.193.154:6821/1364755569","state":["exists","up"]},{"osd":9,"uuid":"a3befdc3-c847-4659-9ec1-0dd5e3172fe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6827","nonce":1541303371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6829","nonce":1541303371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6833","nonce":1541303371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6831","nonce":1541303371}]},"public_addr":"10.20.193.91:6827/1541303371","cluster_addr":"10.20.193.91:6829/1541303371","heartbeat_back_addr":"10.20.193.91:6833/1541303371","heartbeat_front_addr":"10.20.193.91:6831/1541303371","state":["exists","up"]},{"osd":10,"uuid":"36fe781f-9334-474b-bc6b-01e798e72a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6825","nonce":3309349280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6827","nonce":3309349280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6831","nonce":3309349280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6829","nonce":3309349280}]},"public_addr":"10.20.193.126:6825/3309349280","cluster_addr":"10.20.193.126:6827/3309349280","heartbeat_back_addr":"10.20.193.126:6831/3309349280","heartbeat_front_addr":"10.20.193.126:6829/3309349280","state":["exists","up"]},{"osd":11,"uuid":"5f569e12-4d88-4cf0-8f2e-147ace91f917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6825","nonce":1394532940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6827","nonce":1394532940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6831","nonce":1394532940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6829","nonce":1394532940}]},"public_addr":"10.20.193.154:6825/1394532940","cluster_addr":"10.20.193.154:6827/1394532940","heartbeat_back_addr":"10.20.193.154:6831/1394532940","heartbeat_front_addr":"10.20.193.154:6829/1394532940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:34.061683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.894443+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:47.963906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.184288+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:02.378327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:09.561223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:16.947535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:24.187301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.493620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:38.824765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.268089+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:53.733044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.91:6801/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/624457179":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/335308306":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/2950715894":"2026-02-14T01:22:48.728580+0000","10.20.193.91:6801/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/3747672627":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/2063745168":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/1509443464":"2026-02-14T01:22:48.728580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9fc40b56d0 msgr2=0x7f9fc40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9fc40b56d0 0x7f9fc40d5b80 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fe8123d10 tx=0x7f9fd0009260 comp rx=0 tx=0).stop 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 msgr2=0x7f9fe811d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe811d380 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9fd802f230 tx=0x7f9fd802fc00 comp rx=0 tx=0).stop 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 shutdown_connections 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9fc40b56d0 0x7f9fc40d5b80 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9fe8122c80 0x7f9fe8123120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9fe8115440 0x7f9fe811d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 --2- 10.20.193.91:0/1413837639 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9fe810f230 0x7f9fe811d380 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 >> 10.20.193.91:0/1413837639 conn(0x7f9fe80ecb30 msgr2=0x7f9fe810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 shutdown_connections 2026-02-13T01:25:14.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.329+0000 7f9feeed16c0 1 -- 10.20.193.91:0/1413837639 wait complete. 2026-02-13T01:25:14.369 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T01:25:14.488 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 -- 10.20.193.91:0/2590748563 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c1557d0 msgr2=0x7ff94c175bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2590748563 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c1557d0 0x7ff94c175bb0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=9111351794623160456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff94000aa40 tx=0x7ff94002fdf0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 -- 10.20.193.91:0/2590748563 shutdown_connections 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2590748563 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c1557d0 0x7ff94c175bb0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=9111351794623160456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2590748563 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff94c10c3b0 0x7ff94c155290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2590748563 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff94c10baa0 0x7ff94c10be70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 -- 10.20.193.91:0/2590748563 >> 10.20.193.91:0/2590748563 conn(0x7ff94c0e9740 msgr2=0x7ff94c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 -- 10.20.193.91:0/2590748563 shutdown_connections 2026-02-13T01:25:14.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.605+0000 7ff9527136c0 1 -- 10.20.193.91:0/2590748563 wait complete. 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 Processor -- start 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 -- start start 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff94c10baa0 0x7ff94c160510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 0x7ff94c160a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff94c1557d0 0x7ff94c165e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c1663d0 con 0x7ff94c10c3b0 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c166540 con 0x7ff94c1557d0 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c166700 con 0x7ff94c10baa0 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 0x7ff94c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 0x7ff94c160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50220/0 (socket says 10.20.193.91:50220) 2026-02-13T01:25:14.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 -- 10.20.193.91:0/2396336457 learned_addr learned my addr 10.20.193.91:0/2396336457 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94bfff6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff94c10baa0 0x7ff94c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff950c856c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff94c1557d0 0x7ff94c165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 -- 10.20.193.91:0/2396336457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff94c10baa0 msgr2=0x7ff94c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff94c10baa0 0x7ff94c160510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 -- 10.20.193.91:0/2396336457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff94c1557d0 msgr2=0x7ff94c165e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff94c1557d0 0x7ff94c165e10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 -- 10.20.193.91:0/2396336457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94000a660 con 0x7ff94c10c3b0 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff94b7fe6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 0x7ff94c160a50 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff93c00b6c0 tx=0x7ff93c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff93c004560 con 0x7ff94c10c3b0 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff93c009030 con 0x7ff94c10c3b0 2026-02-13T01:25:14.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c1669e0 con 0x7ff94c10c3b0 2026-02-13T01:25:14.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.606+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff93c00cd90 con 0x7ff94c10c3b0 2026-02-13T01:25:14.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.607+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c152410 con 0x7ff94c10c3b0 2026-02-13T01:25:14.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.607+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94c05fb10 con 0x7ff94c10c3b0 2026-02-13T01:25:14.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.608+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff93c0026b0 con 0x7ff94c10c3b0 2026-02-13T01:25:14.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.609+0000 7ff9497fa6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9200b56d0 0x7ff9200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:14.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.609+0000 7ff94bfff6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9200b56d0 0x7ff9200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:14.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.609+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7ff93c0e38a0 con 0x7ff94c10c3b0 2026-02-13T01:25:14.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.609+0000 7ff94bfff6c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9200b56d0 0x7ff9200d5b80 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff938004750 tx=0x7ff938009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:14.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.609+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff93c0a6350 con 0x7ff94c10c3b0 2026-02-13T01:25:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:14 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1080358589' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:25:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:14 trial091 ceph-mon[25068]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:25:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:14 trial091 ceph-mon[25068]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T01:25:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:14 trial091 ceph-mon[25068]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T01:25:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:14 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/622976018' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:14 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1413837639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:14.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:14.733+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff94c161660 con 0x7ff94c10c3b0 2026-02-13T01:25:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:14 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1080358589' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:25:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:14 trial126 ceph-mon[26569]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:25:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:14 trial126 ceph-mon[26569]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T01:25:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:14 trial126 ceph-mon[26569]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T01:25:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:14 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/622976018' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:14 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1413837639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:14 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1080358589' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T01:25:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:14 trial154 ceph-mon[27045]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T01:25:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:14 trial154 ceph-mon[27045]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T01:25:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:14 trial154 ceph-mon[27045]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T01:25:14.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:14 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/622976018' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:14.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:14 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1413837639' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:15.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.603+0000 7ff9497fa6c0 1 -- 10.20.193.91:0/2396336457 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7ff93c0a9500 con 0x7ff94c10c3b0 2026-02-13T01:25:15.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9200b56d0 msgr2=0x7ff9200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9200b56d0 0x7ff9200d5b80 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff938004750 tx=0x7ff938009310 comp rx=0 tx=0).stop 2026-02-13T01:25:15.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 msgr2=0x7ff94c160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 0x7ff94c160a50 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff93c00b6c0 tx=0x7ff93c00bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 shutdown_connections 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9200b56d0 0x7ff9200d5b80 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff94c1557d0 0x7ff94c165e10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff94c10c3b0 0x7ff94c160a50 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 --2- 10.20.193.91:0/2396336457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff94c10baa0 0x7ff94c160510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 >> 10.20.193.91:0/2396336457 conn(0x7ff94c0e9740 msgr2=0x7ff94c109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 shutdown_connections 2026-02-13T01:25:15.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.606+0000 7ff9527136c0 1 -- 10.20.193.91:0/2396336457 wait complete. 2026-02-13T01:25:15.645 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2026-02-13T01:25:15.646 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs set cephfs max_mds 5 --yes-i-really-mean-it 2026-02-13T01:25:15.762 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:15.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:15 trial091 ceph-mon[25068]: pgmap v176: 97 pgs: 16 creating+peering, 56 unknown, 25 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 1 op/s 2026-02-13T01:25:15.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:15 trial091 ceph-mon[25068]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:25:15.877 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:15 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6838/561076535,v1:10.20.193.126:6839/561076535] up:active 2026-02-13T01:25:15.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:15 trial091 ceph-mon[25068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:15.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:15 trial091 ceph-mon[25068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:15.878 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:15 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2396336457' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 -- 10.20.193.91:0/111864826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de8115410 msgr2=0x7f7de8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/111864826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de8115410 0x7f7de8175db0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=13744249390143858301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ddc00aa70 tx=0x7f7ddc02fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 -- 10.20.193.91:0/111864826 shutdown_connections 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/111864826 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de8115410 0x7f7de8175db0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=13744249390143858301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/111864826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7de810fbf0 0x7f7de8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/111864826 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7de810f200 0x7f7de810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 -- 10.20.193.91:0/111864826 >> 10.20.193.91:0/111864826 conn(0x7f7de80ecb00 msgr2=0x7f7de810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 -- 10.20.193.91:0/111864826 shutdown_connections 2026-02-13T01:25:15.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.880+0000 7f7dedb616c0 1 -- 10.20.193.91:0/111864826 wait complete. 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 Processor -- start 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 -- start start 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 0x7f7de811d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7de8115410 0x7f7de811d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7de8122af0 0x7f7de8122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8123500 con 0x7f7de810f200 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8123670 con 0x7f7de8115410 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8123830 con 0x7f7de8122af0 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 0x7f7de811d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 0x7f7de811d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50248/0 (socket says 10.20.193.91:50248) 2026-02-13T01:25:15.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 -- 10.20.193.91:0/1391090127 learned_addr learned my addr 10.20.193.91:0/1391090127 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de7fff6c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7de8122af0 0x7f7de8122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 -- 10.20.193.91:0/1391090127 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7de8122af0 msgr2=0x7f7de8122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7de8122af0 0x7f7de8122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 -- 10.20.193.91:0/1391090127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7de8115410 msgr2=0x7f7de811d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7de8115410 0x7f7de811d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 -- 10.20.193.91:0/1391090127 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc00a660 con 0x7f7de810f200 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de77fe6c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 0x7f7de811d1f0 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dd4005dc0 tx=0x7f7dd400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dd4004250 con 0x7f7de810f200 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de8163ce0 con 0x7f7de810f200 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7dd4009070 con 0x7f7de810f200 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dd400cd70 con 0x7f7de810f200 2026-02-13T01:25:15.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.881+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de8164170 con 0x7f7de810f200 2026-02-13T01:25:15.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.882+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de81104d0 con 0x7f7de810f200 2026-02-13T01:25:15.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.883+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7dd40028c0 con 0x7f7de810f200 2026-02-13T01:25:15.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.884+0000 7f7de4ff96c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7dbc0b5650 0x7f7dbc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:15.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.884+0000 7f7de6ffd6c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7dbc0b5650 0x7f7dbc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:15.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.884+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f7dd40e3ba0 con 0x7f7de810f200 2026-02-13T01:25:15.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.885+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7dd411c600 con 0x7f7de810f200 2026-02-13T01:25:15.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:15.885+0000 7f7de6ffd6c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7dbc0b5650 0x7f7dbc0d5b00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dd8005980 tx=0x7f7dd8005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:15 trial154 ceph-mon[27045]: pgmap v176: 97 pgs: 16 creating+peering, 56 unknown, 25 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 1 op/s 2026-02-13T01:25:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:15 trial154 ceph-mon[27045]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:25:15.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:15 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6838/561076535,v1:10.20.193.126:6839/561076535] up:active 2026-02-13T01:25:15.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:15 trial154 ceph-mon[27045]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:15.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:15 trial154 ceph-mon[27045]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:15.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:15 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2396336457' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:25:15.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.000+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} v 0) -- 0x7f7de810fbf0 con 0x7f7de810f200 2026-02-13T01:25:16.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:15 trial126 ceph-mon[26569]: pgmap v176: 97 pgs: 16 creating+peering, 56 unknown, 25 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 1 op/s 2026-02-13T01:25:16.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:15 trial126 ceph-mon[26569]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T01:25:16.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:15 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6838/561076535,v1:10.20.193.126:6839/561076535] up:active 2026-02-13T01:25:16.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:15 trial126 ceph-mon[26569]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:16.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:15 trial126 ceph-mon[26569]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:16.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:15 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2396336457' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T01:25:16.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.606+0000 7f7de4ff96c0 1 -- 10.20.193.91:0/1391090127 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7f7dd40a6650 con 0x7f7de810f200 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7dbc0b5650 msgr2=0x7f7dbc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7dbc0b5650 0x7f7dbc0d5b00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dd8005980 tx=0x7f7dd8005910 comp rx=0 tx=0).stop 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 msgr2=0x7f7de811d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 0x7f7de811d1f0 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dd4005dc0 tx=0x7f7dd400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 shutdown_connections 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7dbc0b5650 0x7f7dbc0d5b00 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7de8122af0 0x7f7de8122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7de8115410 0x7f7de811d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 --2- 10.20.193.91:0/1391090127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7de810f200 0x7f7de811d1f0 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 >> 10.20.193.91:0/1391090127 conn(0x7f7de80ecb00 msgr2=0x7f7de810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:16.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 shutdown_connections 2026-02-13T01:25:16.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.608+0000 7f7dedb616c0 1 -- 10.20.193.91:0/1391090127 wait complete. 2026-02-13T01:25:16.648 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T01:25:16.765 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:16.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:16 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2396336457' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:25:16.879 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:16 trial091 ceph-mon[25068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:16.880 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:16 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1391090127' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:16.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/2873588542 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d48115440 msgr2=0x7f1d48175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/2873588542 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d48115440 0x7f1d48175de0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=1360473652928115570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d4400aa70 tx=0x7f1d4402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/2873588542 shutdown_connections 2026-02-13T01:25:16.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/2873588542 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d48115440 0x7f1d48175de0 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=1360473652928115570 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/2873588542 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d4810fc20 0x7f1d48114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/2873588542 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d4810f230 0x7f1d4810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/2873588542 >> 10.20.193.91:0/2873588542 conn(0x7f1d480ecb30 msgr2=0x7f1d4810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/2873588542 shutdown_connections 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.888+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/2873588542 wait complete. 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 Processor -- start 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 -- start start 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 0x7f1d4811d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d48115440 0x7f1d4811d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d48122b30 0x7f1d48122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1d48123540 con 0x7f1d4810f230 2026-02-13T01:25:16.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1d481236b0 con 0x7f1d48115440 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d48123870 con 0x7f1d48122b30 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 0x7f1d4811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 0x7f1d4811d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50266/0 (socket says 10.20.193.91:50266) 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 -- 10.20.193.91:0/1861975286 learned_addr learned my addr 10.20.193.91:0/1861975286 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4d44c6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d48115440 0x7f1d4811d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4e44e6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d48122b30 0x7f1d48122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 -- 10.20.193.91:0/1861975286 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d48122b30 msgr2=0x7f1d48122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d48122b30 0x7f1d48122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 -- 10.20.193.91:0/1861975286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d48115440 msgr2=0x7f1d4811d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d48115440 0x7f1d4811d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 -- 10.20.193.91:0/1861975286 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4400a660 con 0x7f1d4810f230 2026-02-13T01:25:16.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4e44e6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d48122b30 0x7f1d48122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4dc4d6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 0x7f1d4811d230 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d3800b710 tx=0x7f1d3800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d38004250 con 0x7f1d4810f230 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1d38002d80 con 0x7f1d4810f230 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d48163d20 con 0x7f1d4810f230 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d3800ce20 con 0x7f1d4810f230 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.889+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d48164200 con 0x7f1d4810f230 2026-02-13T01:25:16.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.890+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d48110500 con 0x7f1d4810f230 2026-02-13T01:25:16.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.891+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f1d380043b0 con 0x7f1d4810f230 2026-02-13T01:25:16.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.892+0000 7f1d36ffd6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1d240b56d0 0x7f1d240d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:16.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.892+0000 7f1d4d44c6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1d240b56d0 0x7f1d240d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:16.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.892+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1d380e3b60 con 0x7f1d4810f230 2026-02-13T01:25:16.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.892+0000 7f1d4d44c6c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1d240b56d0 0x7f1d240d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d3c005980 tx=0x7f1d3c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:16.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:16.893+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1d380a6610 con 0x7f1d4810f230 2026-02-13T01:25:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:16 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2396336457' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:25:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:16 trial154 ceph-mon[27045]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:16.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:16 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1391090127' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:17.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.010+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f1d4810f600 con 0x7f1d4810f230 2026-02-13T01:25:17.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:16 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2396336457' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T01:25:17.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:16 trial126 ceph-mon[26569]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:17.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:16 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1391090127' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T01:25:17.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.610+0000 7f1d36ffd6c0 1 -- 10.20.193.91:0/1861975286 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f1d380a97c0 con 0x7f1d4810f230 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1d240b56d0 msgr2=0x7f1d240d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1d240b56d0 0x7f1d240d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d3c005980 tx=0x7f1d3c005910 comp rx=0 tx=0).stop 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 msgr2=0x7f1d4811d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 0x7f1d4811d230 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d3800b710 tx=0x7f1d3800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 shutdown_connections 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1d240b56d0 0x7f1d240d5b80 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d48122b30 0x7f1d48122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d48115440 0x7f1d4811d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 --2- 10.20.193.91:0/1861975286 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d4810f230 0x7f1d4811d230 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 >> 10.20.193.91:0/1861975286 conn(0x7f1d480ecb30 msgr2=0x7f1d4810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 shutdown_connections 2026-02-13T01:25:17.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.612+0000 7f1d4fed86c0 1 -- 10.20.193.91:0/1861975286 wait complete. 2026-02-13T01:25:17.656 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T01:25:17.772 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:17.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: pgmap v178: 97 pgs: 16 creating+peering, 8 unknown, 73 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 3 op/s 2026-02-13T01:25:17.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:25:17.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1391090127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:25:17.886 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:25:17.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:17.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T01:25:17.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T01:25:17.887 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:17 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1861975286' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:25:17.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- 10.20.193.91:0/3350042437 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c10f230 msgr2=0x7f004c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- 10.20.193.91:0/3350042437 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c10f230 0x7f004c10f600 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=3916837640756545056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003c0099a0 tx=0x7f003c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:17.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- 10.20.193.91:0/3350042437 shutdown_connections 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- 10.20.193.91:0/3350042437 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f004c115440 0x7f004c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- 10.20.193.91:0/3350042437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f004c10fc20 0x7f004c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- 10.20.193.91:0/3350042437 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c10f230 0x7f004c10f600 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=3916837640756545056 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- 10.20.193.91:0/3350042437 >> 10.20.193.91:0/3350042437 conn(0x7f004c0ecb30 msgr2=0x7f004c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- 10.20.193.91:0/3350042437 shutdown_connections 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- 10.20.193.91:0/3350042437 wait complete. 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 Processor -- start 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- start start 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f004c10f230 0x7f004c11d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f004c115440 0x7f004c11d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 0x7f004c123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f004c1236c0 con 0x7f004c122cb0 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f004c123830 con 0x7f004c115440 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00536706c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f004c1239f0 con 0x7f004c10f230 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f0051be66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 0x7f004c123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f0051be66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 0x7f004c123150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36464/0 (socket says 10.20.193.91:36464) 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f0051be66c0 1 -- 10.20.193.91:0/99532808 learned_addr learned my addr 10.20.193.91:0/99532808 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.894+0000 7f00513e56c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f004c10f230 0x7f004c11d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0050be46c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f004c115440 0x7f004c11d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0051be66c0 1 -- 10.20.193.91:0/99532808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f004c10f230 msgr2=0x7f004c11d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0051be66c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f004c10f230 0x7f004c11d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0051be66c0 1 -- 10.20.193.91:0/99532808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f004c115440 msgr2=0x7f004c11d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:17.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0051be66c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f004c115440 0x7f004c11d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0051be66c0 1 -- 10.20.193.91:0/99532808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c009590 con 0x7f004c122cb0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f0051be66c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 0x7f004c123150 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0048006ea0 tx=0x7f004800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0048003a30 con 0x7f004c122cb0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c163ea0 con 0x7f004c122cb0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f00480054f0 con 0x7f004c122cb0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f004800dcd0 con 0x7f004c122cb0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c164330 con 0x7f004c122cb0 2026-02-13T01:25:17.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.895+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f004c110500 con 0x7f004c122cb0 2026-02-13T01:25:17.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.896+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0048005030 con 0x7f004c122cb0 2026-02-13T01:25:17.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.897+0000 7f003a7fc6c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00280b5650 0x7f00280d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:17.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.897+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f00480e4c70 con 0x7f004c122cb0 2026-02-13T01:25:17.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.897+0000 7f00513e56c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00280b5650 0x7f00280d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:17.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.897+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00480a7720 con 0x7f004c122cb0 2026-02-13T01:25:17.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:17.897+0000 7f00513e56c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00280b5650 0x7f00280d5b00 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003c0092e0 tx=0x7f003c005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: pgmap v178: 97 pgs: 16 creating+peering, 8 unknown, 73 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 3 op/s 2026-02-13T01:25:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:25:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1391090127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:25:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:25:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T01:25:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T01:25:17.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:17 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1861975286' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:25:18.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.010+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f004c10f600 con 0x7f004c122cb0 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: pgmap v178: 97 pgs: 16 creating+peering, 8 unknown, 73 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 3 op/s 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1391090127' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T01:25:18.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T01:25:18.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:17 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1861975286' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T01:25:18.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.599+0000 7f003a7fc6c0 1 -- 10.20.193.91:0/99532808 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f004800de60 con 0x7f004c122cb0 2026-02-13T01:25:18.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00280b5650 msgr2=0x7f00280d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00280b5650 0x7f00280d5b00 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f003c0092e0 tx=0x7f003c005c00 comp rx=0 tx=0).stop 2026-02-13T01:25:18.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 msgr2=0x7f004c123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 0x7f004c123150 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0048006ea0 tx=0x7f004800cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 shutdown_connections 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00280b5650 0x7f00280d5b00 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f004c122cb0 0x7f004c123150 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f004c115440 0x7f004c11d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 --2- 10.20.193.91:0/99532808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f004c10f230 0x7f004c11d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 >> 10.20.193.91:0/99532808 conn(0x7f004c0ecb30 msgr2=0x7f004c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 shutdown_connections 2026-02-13T01:25:18.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.600+0000 7f00536706c0 1 -- 10.20.193.91:0/99532808 wait complete. 2026-02-13T01:25:18.643 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2026-02-13T01:25:18.643 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T01:25:18.760 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:18.848 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: 2026-02-13T01:25:18.575+0000 7f167629d6c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T01:25:18.848 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: 2026-02-13T01:25:18.575+0000 7f167629d6c0 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1861975286' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6836/223325597,v1:10.20.193.126:6837/223325597] up:active 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: daemon mds.e is now active in filesystem cephfs as rank 2 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/99532808' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/99532808' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.126:6834/1202805209,v1:10.20.193.126:6835/1202805209] up:active 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T01:25:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:25:18.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=f=up:creating} 3 up:standby-replay 5 up:standby 2026-02-13T01:25:18.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:18 trial126 ceph-mon[26569]: daemon mds.f is now active in filesystem cephfs as rank 3 2026-02-13T01:25:18.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- 10.20.193.91:0/429225730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f410010f230 msgr2=0x7f410010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- 10.20.193.91:0/429225730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f410010f230 0x7f410010f600 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=17586659125553309812 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f00099a0 tx=0x7f40f002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:18.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- 10.20.193.91:0/429225730 shutdown_connections 2026-02-13T01:25:18.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- 10.20.193.91:0/429225730 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4100115440 0x7f4100175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- 10.20.193.91:0/429225730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f410010fc20 0x7f4100114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- 10.20.193.91:0/429225730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f410010f230 0x7f410010f600 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=17586659125553309812 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- 10.20.193.91:0/429225730 >> 10.20.193.91:0/429225730 conn(0x7f41000ecb30 msgr2=0x7f410010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:18.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- 10.20.193.91:0/429225730 shutdown_connections 2026-02-13T01:25:18.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- 10.20.193.91:0/429225730 wait complete. 2026-02-13T01:25:18.874 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1861975286' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:25:18.874 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6836/223325597,v1:10.20.193.126:6837/223325597] up:active 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: daemon mds.e is now active in filesystem cephfs as rank 2 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/99532808' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/99532808' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.126:6834/1202805209,v1:10.20.193.126:6835/1202805209] up:active 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=f=up:creating} 3 up:standby-replay 5 up:standby 2026-02-13T01:25:18.875 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:18 trial091 ceph-mon[25068]: daemon mds.f is now active in filesystem cephfs as rank 3 2026-02-13T01:25:18.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 Processor -- start 2026-02-13T01:25:18.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- start start 2026-02-13T01:25:18.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f410010f230 0x7f410011d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 0x7f410011d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4100122cb0 0x7f4100123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f41001236c0 con 0x7f4100115440 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4100123830 con 0x7f4100122cb0 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f41079c96c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41001239f0 con 0x7f410010f230 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f4104f396c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 0x7f410011d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f4104f396c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 0x7f410011d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36488/0 (socket says 10.20.193.91:36488) 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.874+0000 7f4104f396c0 1 -- 10.20.193.91:0/2647894001 learned_addr learned my addr 10.20.193.91:0/2647894001 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4105f3b6c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4100122cb0 0x7f4100123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f410573a6c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f410010f230 0x7f410011d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4104f396c0 1 -- 10.20.193.91:0/2647894001 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f410010f230 msgr2=0x7f410011d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4104f396c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f410010f230 0x7f410011d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4104f396c0 1 -- 10.20.193.91:0/2647894001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4100122cb0 msgr2=0x7f4100123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4104f396c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4100122cb0 0x7f4100123150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4104f396c0 1 -- 10.20.193.91:0/2647894001 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f0009590 con 0x7f4100115440 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4105f3b6c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4100122cb0 0x7f4100123150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f4104f396c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 0x7f410011d8f0 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f4005dc0 tx=0x7f40f400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40f4004250 con 0x7f4100115440 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f40f4009070 con 0x7f4100115440 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4100163ea0 con 0x7f4100115440 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f40f400cd50 con 0x7f4100115440 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4100164380 con 0x7f4100115440 2026-02-13T01:25:18.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.875+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4100110500 con 0x7f4100115440 2026-02-13T01:25:18.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.877+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f40f40028c0 con 0x7f4100115440 2026-02-13T01:25:18.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.877+0000 7f40ee7fc6c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f40dc0b56d0 0x7f40dc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:18.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.877+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f40f40e3ac0 con 0x7f4100115440 2026-02-13T01:25:18.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.877+0000 7f410573a6c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f40dc0b56d0 0x7f40dc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:18.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.877+0000 7f410573a6c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f40dc0b56d0 0x7f40dc0d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f00092e0 tx=0x7f40f0005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:18.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.878+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f40f40a6570 con 0x7f4100115440 2026-02-13T01:25:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1861975286' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T01:25:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6836/223325597,v1:10.20.193.126:6837/223325597] up:active 2026-02-13T01:25:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T01:25:18.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: daemon mds.e is now active in filesystem cephfs as rank 2 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/99532808' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/99532808' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.126:6834/1202805209,v1:10.20.193.126:6835/1202805209] up:active 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=f=up:creating} 3 up:standby-replay 5 up:standby 2026-02-13T01:25:18.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:18 trial154 ceph-mon[27045]: daemon mds.f is now active in filesystem cephfs as rank 3 2026-02-13T01:25:18.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:18.988+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f410011e500 con 0x7f40dc0b56d0 2026-02-13T01:25:19.228 INFO:journalctl@ceph.mgr.x.trial091.stdout:Feb 13 01:25:18 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mgr-x[25328]: 2026-02-13T01:25:18.995+0000 7fcad926b6c0 -1 client.14889 error registering admin socket command: (17) File exists 2026-02-13T01:25:19.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.617+0000 7f40ee7fc6c0 1 -- 10.20.193.91:0/2647894001 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f410011e500 con 0x7f40dc0b56d0 2026-02-13T01:25:19.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f40dc0b56d0 msgr2=0x7f40dc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f40dc0b56d0 0x7f40dc0d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f00092e0 tx=0x7f40f0005c00 comp rx=0 tx=0).stop 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 msgr2=0x7f410011d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 0x7f410011d8f0 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f40f4005dc0 tx=0x7f40f400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 shutdown_connections 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f40dc0b56d0 0x7f40dc0d5b80 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4100122cb0 0x7f4100123150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4100115440 0x7f410011d8f0 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 --2- 10.20.193.91:0/2647894001 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f410010f230 0x7f410011d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 >> 10.20.193.91:0/2647894001 conn(0x7f41000ecb30 msgr2=0x7f410010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:19.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 shutdown_connections 2026-02-13T01:25:19.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.619+0000 7f41079c96c0 1 -- 10.20.193.91:0/2647894001 wait complete. 2026-02-13T01:25:19.659 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T01:25:19.777 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2669532243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c60115440 msgr2=0x7f2c60175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2669532243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c60115440 0x7f2c60175de0 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=2311641149840907161 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c5400aa70 tx=0x7f2c5402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2669532243 shutdown_connections 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2669532243 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c60115440 0x7f2c60175de0 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=2311641149840907161 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2669532243 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c6010fc20 0x7f2c60114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2669532243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c6010f230 0x7f2c6010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2669532243 >> 10.20.193.91:0/2669532243 conn(0x7f2c600ecb30 msgr2=0x7f2c6010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2669532243 shutdown_connections 2026-02-13T01:25:19.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2669532243 wait complete. 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: pgmap v179: 97 pgs: 97 active+clean; 579 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s wr, 12 op/s 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.154:6834/2887274444,v1:10.20.193.154:6835/2887274444] up:active 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=f=up:active} 3 up:standby-replay 5 up:standby 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2026-02-13T01:25:19.894 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:19 trial091 ceph-mon[25068]: daemon mds.l is now active in filesystem cephfs as rank 4 2026-02-13T01:25:19.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 Processor -- start 2026-02-13T01:25:19.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.893+0000 7f2c65d7b6c0 1 -- start start 2026-02-13T01:25:19.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 0x7f2c6011d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c60115440 0x7f2c6011d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c60122b80 0x7f2c60123020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60123590 con 0x7f2c6010f230 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60123700 con 0x7f2c60115440 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601238c0 con 0x7f2c60122b80 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 0x7f2c6011d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 0x7f2c6011d280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36524/0 (socket says 10.20.193.91:36524) 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 -- 10.20.193.91:0/2203300010 learned_addr learned my addr 10.20.193.91:0/2203300010 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5effd6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c60115440 0x7f2c6011d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 -- 10.20.193.91:0/2203300010 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c60122b80 msgr2=0x7f2c60123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:19.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5ffff6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c60122b80 0x7f2c60123020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c60122b80 0x7f2c60123020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 -- 10.20.193.91:0/2203300010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c60115440 msgr2=0x7f2c6011d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c60115440 0x7f2c6011d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 -- 10.20.193.91:0/2203300010 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5400a660 con 0x7f2c6010f230 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5ffff6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c60122b80 0x7f2c60123020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5effd6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c60115440 0x7f2c6011d7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5f7fe6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 0x7f2c6011d280 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4c009490 tx=0x7f2c4c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c4c004a80 con 0x7f2c6010f230 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c60163d70 con 0x7f2c6010f230 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2c4c009030 con 0x7f2c6010f230 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c4c00ce30 con 0x7f2c6010f230 2026-02-13T01:25:19.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.894+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c60164250 con 0x7f2c6010f230 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.895+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c60110500 con 0x7f2c6010f230 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.896+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f2c4c004060 con 0x7f2c6010f230 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.896+0000 7f2c5cff96c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2c340b5650 0x7f2c340d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.897+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f2c4c0e3b50 con 0x7f2c6010f230 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.897+0000 7f2c5effd6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2c340b5650 0x7f2c340d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.897+0000 7f2c5effd6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2c340b5650 0x7f2c340d5b00 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c50005e40 tx=0x7f2c50005db0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:19.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:19.897+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c4c0a6640 con 0x7f2c6010f230 2026-02-13T01:25:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: pgmap v179: 97 pgs: 97 active+clean; 579 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s wr, 12 op/s 2026-02-13T01:25:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.154:6834/2887274444,v1:10.20.193.154:6835/2887274444] up:active 2026-02-13T01:25:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T01:25:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:25:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=f=up:active} 3 up:standby-replay 5 up:standby 2026-02-13T01:25:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2026-02-13T01:25:19.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:19 trial154 ceph-mon[27045]: daemon mds.l is now active in filesystem cephfs as rank 4 2026-02-13T01:25:20.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.005+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2c6011e3d0 con 0x7f2c340b5650 2026-02-13T01:25:20.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.017+0000 7f2c5cff96c0 1 -- 10.20.193.91:0/2203300010 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c6011e3d0 con 0x7f2c340b5650 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2c340b5650 msgr2=0x7f2c340d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2c340b5650 0x7f2c340d5b00 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c50005e40 tx=0x7f2c50005db0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 msgr2=0x7f2c6011d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 0x7f2c6011d280 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4c009490 tx=0x7f2c4c00bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 shutdown_connections 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2c340b5650 0x7f2c340d5b00 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2c60122b80 0x7f2c60123020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2c60115440 0x7f2c6011d7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 --2- 10.20.193.91:0/2203300010 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2c6010f230 0x7f2c6011d280 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 >> 10.20.193.91:0/2203300010 conn(0x7f2c600ecb30 msgr2=0x7f2c6010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:20.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 shutdown_connections 2026-02-13T01:25:20.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.018+0000 7f2c65d7b6c0 1 -- 10.20.193.91:0/2203300010 wait complete. 2026-02-13T01:25:20.058 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T01:25:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: pgmap v179: 97 pgs: 97 active+clean; 579 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s wr, 12 op/s 2026-02-13T01:25:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.154:6834/2887274444,v1:10.20.193.154:6835/2887274444] up:active 2026-02-13T01:25:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T01:25:20.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T01:25:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=f=up:active} 3 up:standby-replay 5 up:standby 2026-02-13T01:25:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2026-02-13T01:25:20.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:19 trial126 ceph-mon[26569]: daemon mds.l is now active in filesystem cephfs as rank 4 2026-02-13T01:25:20.176 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:20.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.298+0000 7fc88c2316c0 1 -- 10.20.193.91:0/2851491744 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410fc20 msgr2=0x7fc884114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.298+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/2851491744 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410fc20 0x7fc884114c60 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=636544552123551629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8780099a0 tx=0x7fc87802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:20.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.298+0000 7fc88c2316c0 1 -- 10.20.193.91:0/2851491744 shutdown_connections 2026-02-13T01:25:20.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.298+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/2851491744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc884115440 0x7fc884175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.298+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/2851491744 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410fc20 0x7fc884114c60 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=636544552123551629 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.298+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/2851491744 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc88410f230 0x7fc88410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- 10.20.193.91:0/2851491744 >> 10.20.193.91:0/2851491744 conn(0x7fc8840ecb30 msgr2=0x7fc88410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- 10.20.193.91:0/2851491744 shutdown_connections 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- 10.20.193.91:0/2851491744 wait complete. 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 Processor -- start 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- start start 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 0x7fc8840f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc884115440 0x7fc884175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8840f5300 0x7fc8840fa5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc8840f59f0 con 0x7fc88410f230 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc8840fab10 con 0x7fc8840f5300 2026-02-13T01:25:20.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8840facd0 con 0x7fc884115440 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 0x7fc8840f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 0x7fc8840f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36532/0 (socket says 10.20.193.91:36532) 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 -- 10.20.193.91:0/3114681425 learned_addr learned my addr 10.20.193.91:0/3114681425 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc8897a16c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc884115440 0x7fc884175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 -- 10.20.193.91:0/3114681425 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc884115440 msgr2=0x7fc884175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc884115440 0x7fc884175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 -- 10.20.193.91:0/3114681425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8840f5300 msgr2=0x7fc8840fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8840f5300 0x7fc8840fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 -- 10.20.193.91:0/3114681425 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878009590 con 0x7fc88410f230 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc8897a16c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc884115440 0x7fc884175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc889fa26c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 0x7fc8840f4cd0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc87400b710 tx=0x7fc87400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:20.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc874004250 con 0x7fc88410f230 2026-02-13T01:25:20.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc874002d80 con 0x7fc88410f230 2026-02-13T01:25:20.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8840fafb0 con 0x7fc88410f230 2026-02-13T01:25:20.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.299+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc87400cda0 con 0x7fc88410f230 2026-02-13T01:25:20.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.300+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8840fb740 con 0x7fc88410f230 2026-02-13T01:25:20.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.300+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc884110500 con 0x7fc88410f230 2026-02-13T01:25:20.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.301+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fc8740028c0 con 0x7fc88410f230 2026-02-13T01:25:20.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.302+0000 7fc872ffd6c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8600b56d0 0x7fc8600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.302+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc8740e3ac0 con 0x7fc88410f230 2026-02-13T01:25:20.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.302+0000 7fc8897a16c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8600b56d0 0x7fc8600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.302+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc87411c5e0 con 0x7fc88410f230 2026-02-13T01:25:20.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.302+0000 7fc8897a16c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8600b56d0 0x7fc8600d5b80 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8780098c0 tx=0x7fc87802f580 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:20.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.410+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc8840f5eb0 con 0x7fc8600b56d0 2026-02-13T01:25:20.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.413+0000 7fc872ffd6c0 1 -- 10.20.193.91:0/3114681425 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc87802f790 con 0x7fc8600b56d0 2026-02-13T01:25:20.413 INFO:teuthology.orchestra.run.trial091.stdout:/volumes/qa/sv_0/7e287577-518d-4af4-b764-83fb14029cca 2026-02-13T01:25:20.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8600b56d0 msgr2=0x7fc8600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8600b56d0 0x7fc8600d5b80 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8780098c0 tx=0x7fc87802f580 comp rx=0 tx=0).stop 2026-02-13T01:25:20.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 msgr2=0x7fc8840f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 0x7fc8840f4cd0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc87400b710 tx=0x7fc87400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 shutdown_connections 2026-02-13T01:25:20.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8600b56d0 0x7fc8600d5b80 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8840f5300 0x7fc8840fa5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc884115440 0x7fc884175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 --2- 10.20.193.91:0/3114681425 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc88410f230 0x7fc8840f4cd0 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 >> 10.20.193.91:0/3114681425 conn(0x7fc8840ecb30 msgr2=0x7fc884113da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:20.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 shutdown_connections 2026-02-13T01:25:20.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.414+0000 7fc88c2316c0 1 -- 10.20.193.91:0/3114681425 wait complete. 2026-02-13T01:25:20.455 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T01:25:20.571 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:20.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/1480412578 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc115410 msgr2=0x7f49cc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/1480412578 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc115410 0x7f49cc175db0 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=2888921980222066628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49bc00aa70 tx=0x7f49bc02fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/1480412578 shutdown_connections 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/1480412578 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc115410 0x7f49cc175db0 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=2888921980222066628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/1480412578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49cc10fbf0 0x7f49cc114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/1480412578 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc10f200 0x7f49cc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/1480412578 >> 10.20.193.91:0/1480412578 conn(0x7f49cc0ecb00 msgr2=0x7f49cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/1480412578 shutdown_connections 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/1480412578 wait complete. 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 Processor -- start 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- start start 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 0x7f49cc0f4b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc115410 0x7f49cc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49cc0f51a0 0x7f49cc0fa470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc0f5890 con 0x7f49cc10f200 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc0fa9b0 con 0x7f49cc0f51a0 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49d0a2d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc0fab70 con 0x7f49cc115410 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49ca5756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 0x7f49cc0f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49ca5756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 0x7f49cc0f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36556/0 (socket says 10.20.193.91:36556) 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.696+0000 7f49ca5756c0 1 -- 10.20.193.91:0/3681761493 learned_addr learned my addr 10.20.193.91:0/3681761493 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49c9d746c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc115410 0x7f49cc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49cad766c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49cc0f51a0 0x7f49cc0fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49ca5756c0 1 -- 10.20.193.91:0/3681761493 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc115410 msgr2=0x7f49cc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49ca5756c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc115410 0x7f49cc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49ca5756c0 1 -- 10.20.193.91:0/3681761493 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49cc0f51a0 msgr2=0x7f49cc0fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49ca5756c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49cc0f51a0 0x7f49cc0fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49ca5756c0 1 -- 10.20.193.91:0/3681761493 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49bc00a660 con 0x7f49cc10f200 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49c9d746c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc115410 0x7f49cc175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49ca5756c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 0x7f49cc0f4b70 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c0005dc0 tx=0x7f49c000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49c0004250 con 0x7f49cc10f200 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc0fae50 con 0x7f49cc10f200 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f49c0009070 con 0x7f49cc10f200 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49c000cde0 con 0x7f49cc10f200 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc0fb2e0 con 0x7f49cc10f200 2026-02-13T01:25:20.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.697+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49cc1104d0 con 0x7f49cc10f200 2026-02-13T01:25:20.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.699+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f49c00028c0 con 0x7f49cc10f200 2026-02-13T01:25:20.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.699+0000 7f49b37fe6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f49980b5650 0x7f49980d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:20.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.699+0000 7f49c9d746c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f49980b5650 0x7f49980d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:20.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.700+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f49c00e38f0 con 0x7f49cc10f200 2026-02-13T01:25:20.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.700+0000 7f49c9d746c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f49980b5650 0x7f49980d5b00 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49cc0fb500 tx=0x7f49b4009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:20.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.700+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49c00a9550 con 0x7f49cc10f200 2026-02-13T01:25:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:20 trial091 ceph-mon[25068]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:20 trial091 ceph-mon[25068]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:20 trial091 ceph-mon[25068]: mds.? [v2:10.20.193.154:6832/3628315638,v1:10.20.193.154:6833/3628315638] up:active 2026-02-13T01:25:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:20 trial091 ceph-mon[25068]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2026-02-13T01:25:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:20 trial091 ceph-mon[25068]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T01:25:20.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.807+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f49cc0fb2e0 con 0x7f49980b5650 2026-02-13T01:25:20.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.820+0000 7f49b37fe6c0 1 -- 10.20.193.91:0/3681761493 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f49cc0fb2e0 con 0x7f49980b5650 2026-02-13T01:25:20.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f49980b5650 msgr2=0x7f49980d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f49980b5650 0x7f49980d5b00 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49cc0fb500 tx=0x7f49b4009260 comp rx=0 tx=0).stop 2026-02-13T01:25:20.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 msgr2=0x7f49cc0f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:20.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 0x7f49cc0f4b70 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c0005dc0 tx=0x7f49c000bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 shutdown_connections 2026-02-13T01:25:20.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f49980b5650 0x7f49980d5b00 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49cc0f51a0 0x7f49cc0fa470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f49cc115410 0x7f49cc175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 --2- 10.20.193.91:0/3681761493 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f49cc10f200 0x7f49cc0f4b70 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:20.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 >> 10.20.193.91:0/3681761493 conn(0x7f49cc0ecb00 msgr2=0x7f49cc113bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:20.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 shutdown_connections 2026-02-13T01:25:20.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:20.821+0000 7f49d0a2d6c0 1 -- 10.20.193.91:0/3681761493 wait complete. 2026-02-13T01:25:20.861 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T01:25:20.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:20 trial154 ceph-mon[27045]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:20.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:20 trial154 ceph-mon[27045]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:20.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:20 trial154 ceph-mon[27045]: mds.? [v2:10.20.193.154:6832/3628315638,v1:10.20.193.154:6833/3628315638] up:active 2026-02-13T01:25:20.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:20 trial154 ceph-mon[27045]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2026-02-13T01:25:20.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:20 trial154 ceph-mon[27045]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T01:25:20.977 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:21.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- 10.20.193.91:0/3373839824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f652010d970 msgr2=0x7f65201129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- 10.20.193.91:0/3373839824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f652010d970 0x7f65201129b0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=4082043381725642416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65100099a0 tx=0x7f651002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:21.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- 10.20.193.91:0/3373839824 shutdown_connections 2026-02-13T01:25:21.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- 10.20.193.91:0/3373839824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6520113190 0x7f6520173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- 10.20.193.91:0/3373839824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f652010d970 0x7f65201129b0 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=4082043381725642416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- 10.20.193.91:0/3373839824 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f652010cf80 0x7f652010d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- 10.20.193.91:0/3373839824 >> 10.20.193.91:0/3373839824 conn(0x7f65200ea880 msgr2=0x7f652010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- 10.20.193.91:0/3373839824 shutdown_connections 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- 10.20.193.91:0/3373839824 wait complete. 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 Processor -- start 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- start start 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f652010cf80 0x7f65200f2ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 0x7f6520173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65200f3100 0x7f65200f83d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f65200f37f0 con 0x7f6520113190 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f65200f8910 con 0x7f65200f3100 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f65261e46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65200f8ad0 con 0x7f652010cf80 2026-02-13T01:25:21.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 0x7f6520173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 0x7f6520173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36582/0 (socket says 10.20.193.91:36582) 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 -- 10.20.193.91:0/4254461959 learned_addr learned my addr 10.20.193.91:0/4254461959 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651ffff6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65200f3100 0x7f65200f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651f7fe6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f652010cf80 0x7f65200f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 -- 10.20.193.91:0/4254461959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f652010cf80 msgr2=0x7f65200f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f652010cf80 0x7f65200f2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 -- 10.20.193.91:0/4254461959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65200f3100 msgr2=0x7f65200f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65200f3100 0x7f65200f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 -- 10.20.193.91:0/4254461959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6510009590 con 0x7f6520113190 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.092+0000 7f651effd6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 0x7f6520173a30 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65100023c0 tx=0x7f651002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.093+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6510002ae0 con 0x7f6520113190 2026-02-13T01:25:21.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.093+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65200f8d50 con 0x7f6520113190 2026-02-13T01:25:21.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.093+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6510007680 con 0x7f6520113190 2026-02-13T01:25:21.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.093+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65100374d0 con 0x7f6520113190 2026-02-13T01:25:21.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.093+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65200f9220 con 0x7f6520113190 2026-02-13T01:25:21.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.093+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f652010e250 con 0x7f6520113190 2026-02-13T01:25:21.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.094+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f6510007cb0 con 0x7f6520113190 2026-02-13T01:25:21.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.095+0000 7f651cff96c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f64f40b5650 0x7f64f40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.095+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f6510107c10 con 0x7f6520113190 2026-02-13T01:25:21.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.095+0000 7f651f7fe6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f64f40b5650 0x7f64f40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.095+0000 7f651f7fe6c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f64f40b5650 0x7f64f40d5b00 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f650c005980 tx=0x7f650c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.095+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f65100ca6c0 con 0x7f6520113190 2026-02-13T01:25:21.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:20 trial126 ceph-mon[26569]: from='client.14895 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:21.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:20 trial126 ceph-mon[26569]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:21.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:20 trial126 ceph-mon[26569]: mds.? [v2:10.20.193.154:6832/3628315638,v1:10.20.193.154:6833/3628315638] up:active 2026-02-13T01:25:21.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:20 trial126 ceph-mon[26569]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2026-02-13T01:25:21.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:20 trial126 ceph-mon[26569]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T01:25:21.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.203+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f65200f3c20 con 0x7f64f40b5650 2026-02-13T01:25:21.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.205+0000 7f651cff96c0 1 -- 10.20.193.91:0/4254461959 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f65200f3c20 con 0x7f64f40b5650 2026-02-13T01:25:21.205 INFO:teuthology.orchestra.run.trial091.stdout:/volumes/qa/sv_1/5b424d06-221b-48ae-a859-c2f2f17ece44 2026-02-13T01:25:21.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f64f40b5650 msgr2=0x7f64f40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f64f40b5650 0x7f64f40d5b00 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f650c005980 tx=0x7f650c005910 comp rx=0 tx=0).stop 2026-02-13T01:25:21.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 msgr2=0x7f6520173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 0x7f6520173a30 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65100023c0 tx=0x7f651002fbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 shutdown_connections 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f64f40b5650 0x7f64f40d5b00 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65200f3100 0x7f65200f83d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6520113190 0x7f6520173a30 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 --2- 10.20.193.91:0/4254461959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f652010cf80 0x7f65200f2ad0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 >> 10.20.193.91:0/4254461959 conn(0x7f65200ea880 msgr2=0x7f652010fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 shutdown_connections 2026-02-13T01:25:21.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.206+0000 7f65261e46c0 1 -- 10.20.193.91:0/4254461959 wait complete. 2026-02-13T01:25:21.246 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T01:25:21.362 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.482+0000 7f55ecb916c0 1 -- 10.20.193.91:0/3800548036 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 msgr2=0x7f55e810d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.482+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/3800548036 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e810d380 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=3095171973926679098 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc0099a0 tx=0x7f55dc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- 10.20.193.91:0/3800548036 shutdown_connections 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/3800548036 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55e81131c0 0x7f55e8173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/3800548036 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f55e810d9a0 0x7f55e81129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/3800548036 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e810d380 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=3095171973926679098 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- 10.20.193.91:0/3800548036 >> 10.20.193.91:0/3800548036 conn(0x7f55e80ea8b0 msgr2=0x7f55e810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- 10.20.193.91:0/3800548036 shutdown_connections 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- 10.20.193.91:0/3800548036 wait complete. 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 Processor -- start 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- start start 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e80f4d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f55e81131c0 0x7f55e8173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55e80f5360 0x7f55e80fa630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80f5a50 con 0x7f55e810cfb0 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80fab70 con 0x7f55e80f5360 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55ecb916c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55e80fad30 con 0x7f55e81131c0 2026-02-13T01:25:21.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e80f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e80f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36598/0 (socket says 10.20.193.91:36598) 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 -- 10.20.193.91:0/1987283319 learned_addr learned my addr 10.20.193.91:0/1987283319 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e6d766c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55e80f5360 0x7f55e80fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e5d746c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f55e81131c0 0x7f55e8173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 -- 10.20.193.91:0/1987283319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f55e81131c0 msgr2=0x7f55e8173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f55e81131c0 0x7f55e8173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 -- 10.20.193.91:0/1987283319 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55e80f5360 msgr2=0x7f55e80fa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55e80f5360 0x7f55e80fa630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 -- 10.20.193.91:0/1987283319 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc009590 con 0x7f55e810cfb0 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55e65756c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e80f4d30 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc02f230 tx=0x7f55dc02fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc002ae0 con 0x7f55e810cfb0 2026-02-13T01:25:21.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.483+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f55dc002c40 con 0x7f55e810cfb0 2026-02-13T01:25:21.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.484+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e80fafb0 con 0x7f55e810cfb0 2026-02-13T01:25:21.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.484+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f55dc0362f0 con 0x7f55e810cfb0 2026-02-13T01:25:21.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.484+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e80fb480 con 0x7f55e810cfb0 2026-02-13T01:25:21.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.484+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e810e280 con 0x7f55e810cfb0 2026-02-13T01:25:21.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.485+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f55dc007810 con 0x7f55e810cfb0 2026-02-13T01:25:21.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.486+0000 7f55cf7fe6c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f55c00b56d0 0x7f55c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.486+0000 7f55e5d746c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f55c00b56d0 0x7f55c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.486+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f55dc107bb0 con 0x7f55e810cfb0 2026-02-13T01:25:21.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.486+0000 7f55e5d746c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f55c00b56d0 0x7f55c00d5b80 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e80fb6c0 tx=0x7f55d0009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.486+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f55dc0ca660 con 0x7f55e810cfb0 2026-02-13T01:25:21.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.604+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e810d380 con 0x7f55e810cfb0 2026-02-13T01:25:21.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.605+0000 7f55cf7fe6c0 1 -- 10.20.193.91:0/1987283319 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12004 (secure 0 0 0) 0x7f55dc0cd810 con 0x7f55e810cfb0 2026-02-13T01:25:21.605 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:21.605 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":26,"btime":"2026-02-13T01:25:20:611195+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14745,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6835/2335686987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6834","nonce":2335686987},{"type":"v1","addr":"10.20.193.91:6835","nonce":2335686987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14757,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.91:6837/1529166455","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6836","nonce":1529166455},{"type":"v1","addr":"10.20.193.91:6837","nonce":1529166455}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T01:25:12.984126+0000","modified":"2026-02-13T01:25:20.611190+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24638,"mds_1":24611,"mds_2":24593,"mds_3":24562,"mds_4":24526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14793":{"gid":14793,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.91:6839/330713711","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6838","nonce":330713711},{"type":"v1","addr":"10.20.193.91:6839","nonce":330713711}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14799":{"gid":14799,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.91:6841/3913743624","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6840","nonce":3913743624},{"type":"v1","addr":"10.20.193.91:6841","nonce":3913743624}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24526":{"gid":24526,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":7,"addr":"10.20.193.154:6833/3628315638","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6832","nonce":3628315638},{"type":"v1","addr":"10.20.193.154:6833","nonce":3628315638}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"f","rank":3,"incarnation":22,"state":"up:active","state_seq":5,"addr":"10.20.193.154:6835/2887274444","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6834","nonce":2887274444},{"type":"v1","addr":"10.20.193.154:6835","nonce":2887274444}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24568":{"gid":24568,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.154:6837/1555539539","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6836","nonce":1555539539},{"type":"v1","addr":"10.20.193.154:6837","nonce":1555539539}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24575":{"gid":24575,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6833/2773810578","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":2773810578},{"type":"v1","addr":"10.20.193.126:6833","nonce":2773810578}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24577":{"gid":24577,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.154:6839/987021594","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6838","nonce":987021594},{"type":"v1","addr":"10.20.193.154:6839","nonce":987021594}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24593":{"gid":24593,"name":"e","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.126:6835/1202805209","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":1202805209},{"type":"v1","addr":"10.20.193.126:6835","nonce":1202805209}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24611":{"gid":24611,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.126:6837/223325597","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":223325597},{"type":"v1","addr":"10.20.193.126:6837","nonce":223325597}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/561076535","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":561076535},{"type":"v1","addr":"10.20.193.126:6839","nonce":561076535}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24638,"qdb_cluster":[24638,24611,24593,24562,24526]},"id":1}]} 2026-02-13T01:25:21.606 INFO:teuthology.orchestra.run.trial091.stderr:dumped fsmap epoch 26 2026-02-13T01:25:21.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f55c00b56d0 msgr2=0x7f55c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f55c00b56d0 0x7f55c00d5b80 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55e80fb6c0 tx=0x7f55d0009260 comp rx=0 tx=0).stop 2026-02-13T01:25:21.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 msgr2=0x7f55e80f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e80f4d30 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f55dc02f230 tx=0x7f55dc02fc00 comp rx=0 tx=0).stop 2026-02-13T01:25:21.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 shutdown_connections 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f55c00b56d0 0x7f55c00d5b80 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55e80f5360 0x7f55e80fa630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f55e81131c0 0x7f55e8173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 --2- 10.20.193.91:0/1987283319 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f55e810cfb0 0x7f55e80f4d30 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 >> 10.20.193.91:0/1987283319 conn(0x7f55e80ea8b0 msgr2=0x7f55e810b650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 shutdown_connections 2026-02-13T01:25:21.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.606+0000 7f55ecb916c0 1 -- 10.20.193.91:0/1987283319 wait complete. 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: pgmap v180: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]} : dispatch 2026-02-13T01:25:21.636 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]} : dispatch 2026-02-13T01:25:21.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2026-02-13T01:25:21.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2026-02-13T01:25:21.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2026-02-13T01:25:21.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-13T01:25:21.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2026-02-13T01:25:21.637 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:21 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1987283319' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:21.652 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:21.766 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:21.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- 10.20.193.91:0/238878375 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 msgr2=0x7fab7010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- 10.20.193.91:0/238878375 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7010f5d0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=16121806150823229826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab600099a0 tx=0x7fab6002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- 10.20.193.91:0/238878375 shutdown_connections 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- 10.20.193.91:0/238878375 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab70115410 0x7fab70175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- 10.20.193.91:0/238878375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fab7010fbf0 0x7fab70114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- 10.20.193.91:0/238878375 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7010f5d0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=16121806150823229826 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- 10.20.193.91:0/238878375 >> 10.20.193.91:0/238878375 conn(0x7fab700ecb00 msgr2=0x7fab7010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- 10.20.193.91:0/238878375 shutdown_connections 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- 10.20.193.91:0/238878375 wait complete. 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 Processor -- start 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- start start 2026-02-13T01:25:21.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7011d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab70115410 0x7fab7011d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fab70122c50 0x7fab701230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fab70123660 con 0x7fab7010f200 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fab701237d0 con 0x7fab70122c50 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab777a06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab70123990 con 0x7fab70115410 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7011d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7011d350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36618/0 (socket says 10.20.193.91:36618) 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 -- 10.20.193.91:0/4190272638 learned_addr learned my addr 10.20.193.91:0/4190272638 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab74d106c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab70115410 0x7fab7011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab75d126c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fab70122c50 0x7fab701230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 -- 10.20.193.91:0/4190272638 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab70115410 msgr2=0x7fab7011d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab70115410 0x7fab7011d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 -- 10.20.193.91:0/4190272638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fab70122c50 msgr2=0x7fab701230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.881+0000 7fab755116c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fab70122c50 0x7fab701230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab755116c0 1 -- 10.20.193.91:0/4190272638 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab60009590 con 0x7fab7010f200 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab755116c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7011d350 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab6002f230 tx=0x7fab6002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab60002ba0 con 0x7fab7010f200 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fab60002d00 con 0x7fab7010f200 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab70163de0 con 0x7fab7010f200 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fab600372f0 con 0x7fab7010f200 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab70164260 con 0x7fab7010f200 2026-02-13T01:25:21.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.882+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab701104d0 con 0x7fab7010f200 2026-02-13T01:25:21.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.884+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fab600078d0 con 0x7fab7010f200 2026-02-13T01:25:21.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.884+0000 7fab5e7fc6c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fab4c0b5760 0x7fab4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:21.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.884+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7fab60107e70 con 0x7fab7010f200 2026-02-13T01:25:21.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.884+0000 7fab74d106c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fab4c0b5760 0x7fab4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:21.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.884+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fab600ca6b0 con 0x7fab7010f200 2026-02-13T01:25:21.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.885+0000 7fab74d106c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fab4c0b5760 0x7fab4c0d5c10 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab64005980 tx=0x7fab64005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:21.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: pgmap v180: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-13T01:25:21.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:21.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:21.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2026-02-13T01:25:21.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:21 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1987283319' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:21.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.975+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab7010fbf0 con 0x7fab7010f200 2026-02-13T01:25:21.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.976+0000 7fab5e7fc6c0 1 -- 10.20.193.91:0/4190272638 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22799 (secure 0 0 0) 0x7fab600cd860 con 0x7fab7010f200 2026-02-13T01:25:21.975 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:21.976 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":76,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","created":"2026-02-13T01:22:42.667442+0000","modified":"2026-02-13T01:25:21.617445+0000","last_up_change":"2026-02-13T01:24:55.419630+0000","last_in_change":"2026-02-13T01:24:47.172971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:51.498651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:10.736175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:11.959007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1ffbd7ff-7a87-4947-8ce2-ad23813a7754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6803","nonce":170892896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6805","nonce":170892896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6809","nonce":170892896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6807","nonce":170892896}]},"public_addr":"10.20.193.91:6803/170892896","cluster_addr":"10.20.193.91:6805/170892896","heartbeat_back_addr":"10.20.193.91:6809/170892896","heartbeat_front_addr":"10.20.193.91:6807/170892896","state":["exists","up"]},{"osd":1,"uuid":"5d698ba3-8a17-455c-b05d-8ca1c9d44466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6801","nonce":1754332231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6803","nonce":1754332231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6807","nonce":1754332231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6805","nonce":1754332231}]},"public_addr":"10.20.193.126:6801/1754332231","cluster_addr":"10.20.193.126:6803/1754332231","heartbeat_back_addr":"10.20.193.126:6807/1754332231","heartbeat_front_addr":"10.20.193.126:6805/1754332231","state":["exists","up"]},{"osd":2,"uuid":"4b9d9a44-7956-4117-ada8-cb99016ae048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6801","nonce":1701976259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6803","nonce":1701976259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6807","nonce":1701976259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6805","nonce":1701976259}]},"public_addr":"10.20.193.154:6801/1701976259","cluster_addr":"10.20.193.154:6803/1701976259","heartbeat_back_addr":"10.20.193.154:6807/1701976259","heartbeat_front_addr":"10.20.193.154:6805/1701976259","state":["exists","up"]},{"osd":3,"uuid":"bb667b65-2ce1-4131-88de-53efa7c8fb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6811","nonce":746110270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6813","nonce":746110270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6817","nonce":746110270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6815","nonce":746110270}]},"public_addr":"10.20.193.91:6811/746110270","cluster_addr":"10.20.193.91:6813/746110270","heartbeat_back_addr":"10.20.193.91:6817/746110270","heartbeat_front_addr":"10.20.193.91:6815/746110270","state":["exists","up"]},{"osd":4,"uuid":"a2569ae9-0cac-4935-94f5-bfcbd0376cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6809","nonce":2328526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6811","nonce":2328526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6815","nonce":2328526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6813","nonce":2328526761}]},"public_addr":"10.20.193.126:6809/2328526761","cluster_addr":"10.20.193.126:6811/2328526761","heartbeat_back_addr":"10.20.193.126:6815/2328526761","heartbeat_front_addr":"10.20.193.126:6813/2328526761","state":["exists","up"]},{"osd":5,"uuid":"6279cc06-cf48-430f-929b-fde87b33e114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6809","nonce":2892893681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6811","nonce":2892893681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6815","nonce":2892893681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6813","nonce":2892893681}]},"public_addr":"10.20.193.154:6809/2892893681","cluster_addr":"10.20.193.154:6811/2892893681","heartbeat_back_addr":"10.20.193.154:6815/2892893681","heartbeat_front_addr":"10.20.193.154:6813/2892893681","state":["exists","up"]},{"osd":6,"uuid":"47579bf9-6170-4408-810f-8be850659d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6819","nonce":1887880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6821","nonce":1887880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6825","nonce":1887880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6823","nonce":1887880552}]},"public_addr":"10.20.193.91:6819/1887880552","cluster_addr":"10.20.193.91:6821/1887880552","heartbeat_back_addr":"10.20.193.91:6825/1887880552","heartbeat_front_addr":"10.20.193.91:6823/1887880552","state":["exists","up"]},{"osd":7,"uuid":"5ec7f6c4-8479-4e14-855e-fa3b594f058c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6817","nonce":1270299623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6819","nonce":1270299623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6823","nonce":1270299623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6821","nonce":1270299623}]},"public_addr":"10.20.193.126:6817/1270299623","cluster_addr":"10.20.193.126:6819/1270299623","heartbeat_back_addr":"10.20.193.126:6823/1270299623","heartbeat_front_addr":"10.20.193.126:6821/1270299623","state":["exists","up"]},{"osd":8,"uuid":"19fbc479-f0bf-46d3-9d48-648388632fb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6817","nonce":1364755569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6819","nonce":1364755569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6823","nonce":1364755569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6821","nonce":1364755569}]},"public_addr":"10.20.193.154:6817/1364755569","cluster_addr":"10.20.193.154:6819/1364755569","heartbeat_back_addr":"10.20.193.154:6823/1364755569","heartbeat_front_addr":"10.20.193.154:6821/1364755569","state":["exists","up"]},{"osd":9,"uuid":"a3befdc3-c847-4659-9ec1-0dd5e3172fe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6827","nonce":1541303371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6829","nonce":1541303371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6833","nonce":1541303371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6831","nonce":1541303371}]},"public_addr":"10.20.193.91:6827/1541303371","cluster_addr":"10.20.193.91:6829/1541303371","heartbeat_back_addr":"10.20.193.91:6833/1541303371","heartbeat_front_addr":"10.20.193.91:6831/1541303371","state":["exists","up"]},{"osd":10,"uuid":"36fe781f-9334-474b-bc6b-01e798e72a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6825","nonce":3309349280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6827","nonce":3309349280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6831","nonce":3309349280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6829","nonce":3309349280}]},"public_addr":"10.20.193.126:6825/3309349280","cluster_addr":"10.20.193.126:6827/3309349280","heartbeat_back_addr":"10.20.193.126:6831/3309349280","heartbeat_front_addr":"10.20.193.126:6829/3309349280","state":["exists","up"]},{"osd":11,"uuid":"5f569e12-4d88-4cf0-8f2e-147ace91f917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6825","nonce":1394532940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6827","nonce":1394532940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6831","nonce":1394532940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6829","nonce":1394532940}]},"public_addr":"10.20.193.154:6825/1394532940","cluster_addr":"10.20.193.154:6827/1394532940","heartbeat_back_addr":"10.20.193.154:6831/1394532940","heartbeat_front_addr":"10.20.193.154:6829/1394532940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:34.061683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.894443+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:47.963906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.184288+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:02.378327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:09.561223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:16.947535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:24.187301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.493620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:38.824765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.268089+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:53.733044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.91:6801/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/624457179":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/335308306":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/2950715894":"2026-02-14T01:22:48.728580+0000","10.20.193.91:6801/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/3747672627":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/2063745168":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/1509443464":"2026-02-14T01:22:48.728580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fab4c0b5760 msgr2=0x7fab4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fab4c0b5760 0x7fab4c0d5c10 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab64005980 tx=0x7fab64005910 comp rx=0 tx=0).stop 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 msgr2=0x7fab7011d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7011d350 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab6002f230 tx=0x7fab6002fd40 comp rx=0 tx=0).stop 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 shutdown_connections 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fab4c0b5760 0x7fab4c0d5c10 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fab70122c50 0x7fab701230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fab70115410 0x7fab7011d890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.977 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 --2- 10.20.193.91:0/4190272638 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fab7010f200 0x7fab7011d350 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:21.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 >> 10.20.193.91:0/4190272638 conn(0x7fab700ecb00 msgr2=0x7fab7010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:21.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 shutdown_connections 2026-02-13T01:25:21.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:21.977+0000 7fab777a06c0 1 -- 10.20.193.91:0/4190272638 wait complete. 2026-02-13T01:25:22.035 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T01:25:22.035 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:22.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: pgmap v180: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 KiB/s rd, 4.9 KiB/s wr, 15 op/s 2026-02-13T01:25:22.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:22.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T01:25:22.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]} : dispatch 2026-02-13T01:25:22.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:21 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1987283319' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T01:25:22.153 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/4246062703 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 msgr2=0x7f6d9c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/4246062703 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c175db0 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=15715609541104061078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8c00aa70 tx=0x7f6d8c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/4246062703 shutdown_connections 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/4246062703 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c175db0 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=15715609541104061078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/4246062703 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d9c10fbf0 0x7f6d9c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/4246062703 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d9c10f200 0x7f6d9c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/4246062703 >> 10.20.193.91:0/4246062703 conn(0x7f6d9c0ecb00 msgr2=0x7f6d9c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:22.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/4246062703 shutdown_connections 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.268+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/4246062703 wait complete. 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 Processor -- start 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 -- start start 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d9c10f200 0x7f6d9c11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d9c122b50 0x7f6d9c122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c123560 con 0x7f6d9c115410 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1236d0 con 0x7f6d9c122b50 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c123890 con 0x7f6d9c10f200 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c11d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36648/0 (socket says 10.20.193.91:36648) 2026-02-13T01:25:22.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 -- 10.20.193.91:0/3684622603 learned_addr learned my addr 10.20.193.91:0/3684622603 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d9ad766c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d9c122b50 0x7f6d9c122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d9a5756c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d9c10f200 0x7f6d9c11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 -- 10.20.193.91:0/3684622603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d9c10f200 msgr2=0x7f6d9c11d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d9c10f200 0x7f6d9c11d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 -- 10.20.193.91:0/3684622603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d9c122b50 msgr2=0x7f6d9c122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d9c122b50 0x7f6d9c122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 -- 10.20.193.91:0/3684622603 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c00a660 con 0x7f6d9c115410 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d99d746c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c11d790 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8400b6c0 tx=0x7f6d8400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d84004250 con 0x7f6d9c115410 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6d84009070 con 0x7f6d9c115410 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9c163d40 con 0x7f6d9c115410 2026-02-13T01:25:22.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.269+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d8400ccb0 con 0x7f6d9c115410 2026-02-13T01:25:22.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.270+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9c1641d0 con 0x7f6d9c115410 2026-02-13T01:25:22.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.270+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9c1104d0 con 0x7f6d9c115410 2026-02-13T01:25:22.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.271+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6d840028c0 con 0x7f6d9c115410 2026-02-13T01:25:22.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.272+0000 7f6d837fe6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6d740b5760 0x7f6d740d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.272+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8238+0+0 (secure 0 0 0) 0x7f6d840e3dc0 con 0x7f6d9c115410 2026-02-13T01:25:22.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.272+0000 7f6d9a5756c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6d740b5760 0x7f6d740d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.272+0000 7f6d9a5756c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6d740b5760 0x7f6d740d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90004750 tx=0x7f6d90009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:22.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.272+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d840a6600 con 0x7f6d9c115410 2026-02-13T01:25:22.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.361+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d9c11e3d0 con 0x7f6d740b5760 2026-02-13T01:25:22.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.363+0000 7f6d837fe6c0 1 -- 10.20.193.91:0/3684622603 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258956 (secure 0 0 0) 0x7f6d9c11e3d0 con 0x7f6d740b5760 2026-02-13T01:25:22.369 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:22.373 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6d740b5760 msgr2=0x7f6d740d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6d740b5760 0x7f6d740d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90004750 tx=0x7f6d90009260 comp rx=0 tx=0).stop 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 msgr2=0x7f6d9c11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c11d790 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8400b6c0 tx=0x7f6d8400bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 shutdown_connections 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6d740b5760 0x7f6d740d5c10 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d9c122b50 0x7f6d9c122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d9c115410 0x7f6d9c11d790 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 --2- 10.20.193.91:0/3684622603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d9c10f200 0x7f6d9c11d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.376 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 >> 10.20.193.91:0/3684622603 conn(0x7f6d9c0ecb00 msgr2=0x7f6d9c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:22.377 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 shutdown_connections 2026-02-13T01:25:22.377 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.365+0000 7f6da0ccc6c0 1 -- 10.20.193.91:0/3684622603 wait complete. 2026-02-13T01:25:22.405 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2026-02-13T01:25:21.622952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598631,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":139,"num_read_kb":119,"num_write":353,"num_write_kb":3771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333532,"kb_used_data":9964,"kb_used_omap":421,"kb_used_meta":322906,"kb_avail":8807704868,"statfs":{"total":9019431321600,"available":9019089784832,"internally_reserved":0,"allocated":10203136,"data_stored":6512028,"data_compressed":114402,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":431310,"internal_metadata":330656562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8263,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":164,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.033921"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946548+0000","last_change":"2026-02-13T01:25:13.598845+0000","last_active":"2026-02-13T01:25:14.946548+0000","last_peered":"2026-02-13T01:25:14.946548+0000","last_clean":"2026-02-13T01:25:14.946548+0000","last_became_active":"2026-02-13T01:25:13.598609+0000","last_became_peered":"2026-02-13T01:25:13.598609+0000","last_unstale":"2026-02-13T01:25:14.946548+0000","last_undegraded":"2026-02-13T01:25:14.946548+0000","last_fullsized":"2026-02-13T01:25:14.946548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:13.127033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.705009+0000","last_change":"2026-02-13T01:25:13.599778+0000","last_active":"2026-02-13T01:25:14.705009+0000","last_peered":"2026-02-13T01:25:14.705009+0000","last_clean":"2026-02-13T01:25:14.705009+0000","last_became_active":"2026-02-13T01:25:13.599585+0000","last_became_peered":"2026-02-13T01:25:13.599585+0000","last_unstale":"2026-02-13T01:25:14.705009+0000","last_undegraded":"2026-02-13T01:25:14.705009+0000","last_fullsized":"2026-02-13T01:25:14.705009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:23:42.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704951+0000","last_change":"2026-02-13T01:25:13.602206+0000","last_active":"2026-02-13T01:25:14.704951+0000","last_peered":"2026-02-13T01:25:14.704951+0000","last_clean":"2026-02-13T01:25:14.704951+0000","last_became_active":"2026-02-13T01:25:13.602099+0000","last_became_peered":"2026-02-13T01:25:13.602099+0000","last_unstale":"2026-02-13T01:25:14.704951+0000","last_undegraded":"2026-02-13T01:25:14.704951+0000","last_fullsized":"2026-02-13T01:25:14.704951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:31.903965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947207+0000","last_change":"2026-02-13T01:25:13.596389+0000","last_active":"2026-02-13T01:25:14.947207+0000","last_peered":"2026-02-13T01:25:14.947207+0000","last_clean":"2026-02-13T01:25:14.947207+0000","last_became_active":"2026-02-13T01:25:13.596165+0000","last_became_peered":"2026-02-13T01:25:13.596165+0000","last_unstale":"2026-02-13T01:25:14.947207+0000","last_undegraded":"2026-02-13T01:25:14.947207+0000","last_fullsized":"2026-02-13T01:25:14.947207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:43:09.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595157+0000","last_change":"2026-02-13T01:25:13.597387+0000","last_active":"2026-02-13T01:25:14.595157+0000","last_peered":"2026-02-13T01:25:14.595157+0000","last_clean":"2026-02-13T01:25:14.595157+0000","last_became_active":"2026-02-13T01:25:13.596351+0000","last_became_peered":"2026-02-13T01:25:13.596351+0000","last_unstale":"2026-02-13T01:25:14.595157+0000","last_undegraded":"2026-02-13T01:25:14.595157+0000","last_fullsized":"2026-02-13T01:25:14.595157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:01.520823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596248+0000","last_change":"2026-02-13T01:25:13.595155+0000","last_active":"2026-02-13T01:25:14.596248+0000","last_peered":"2026-02-13T01:25:14.596248+0000","last_clean":"2026-02-13T01:25:14.596248+0000","last_became_active":"2026-02-13T01:25:13.594858+0000","last_became_peered":"2026-02-13T01:25:13.594858+0000","last_unstale":"2026-02-13T01:25:14.596248+0000","last_undegraded":"2026-02-13T01:25:14.596248+0000","last_fullsized":"2026-02-13T01:25:14.596248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:29:34.717120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932290+0000","last_change":"2026-02-13T01:25:13.596326+0000","last_active":"2026-02-13T01:25:14.932290+0000","last_peered":"2026-02-13T01:25:14.932290+0000","last_clean":"2026-02-13T01:25:14.932290+0000","last_became_active":"2026-02-13T01:25:13.595964+0000","last_became_peered":"2026-02-13T01:25:13.595964+0000","last_unstale":"2026-02-13T01:25:14.932290+0000","last_undegraded":"2026-02-13T01:25:14.932290+0000","last_fullsized":"2026-02-13T01:25:14.932290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:07:18.022160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947760+0000","last_change":"2026-02-13T01:25:13.598247+0000","last_active":"2026-02-13T01:25:14.947760+0000","last_peered":"2026-02-13T01:25:14.947760+0000","last_clean":"2026-02-13T01:25:14.947760+0000","last_became_active":"2026-02-13T01:25:13.598098+0000","last_became_peered":"2026-02-13T01:25:13.598098+0000","last_unstale":"2026-02-13T01:25:14.947760+0000","last_undegraded":"2026-02-13T01:25:14.947760+0000","last_fullsized":"2026-02-13T01:25:14.947760+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:41.227689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947436+0000","last_change":"2026-02-13T01:25:13.601183+0000","last_active":"2026-02-13T01:25:14.947436+0000","last_peered":"2026-02-13T01:25:14.947436+0000","last_clean":"2026-02-13T01:25:14.947436+0000","last_became_active":"2026-02-13T01:25:13.600958+0000","last_became_peered":"2026-02-13T01:25:13.600958+0000","last_unstale":"2026-02-13T01:25:14.947436+0000","last_undegraded":"2026-02-13T01:25:14.947436+0000","last_fullsized":"2026-02-13T01:25:14.947436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:15:12.659724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596776+0000","last_change":"2026-02-13T01:25:13.595002+0000","last_active":"2026-02-13T01:25:14.596776+0000","last_peered":"2026-02-13T01:25:14.596776+0000","last_clean":"2026-02-13T01:25:14.596776+0000","last_became_active":"2026-02-13T01:25:13.594709+0000","last_became_peered":"2026-02-13T01:25:13.594709+0000","last_unstale":"2026-02-13T01:25:14.596776+0000","last_undegraded":"2026-02-13T01:25:14.596776+0000","last_fullsized":"2026-02-13T01:25:14.596776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:42:01.732241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932637+0000","last_change":"2026-02-13T01:25:13.599426+0000","last_active":"2026-02-13T01:25:14.932637+0000","last_peered":"2026-02-13T01:25:14.932637+0000","last_clean":"2026-02-13T01:25:14.932637+0000","last_became_active":"2026-02-13T01:25:13.599121+0000","last_became_peered":"2026-02-13T01:25:13.599121+0000","last_unstale":"2026-02-13T01:25:14.932637+0000","last_undegraded":"2026-02-13T01:25:14.932637+0000","last_fullsized":"2026-02-13T01:25:14.932637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:43.625554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947360+0000","last_change":"2026-02-13T01:25:13.595569+0000","last_active":"2026-02-13T01:25:14.947360+0000","last_peered":"2026-02-13T01:25:14.947360+0000","last_clean":"2026-02-13T01:25:14.947360+0000","last_became_active":"2026-02-13T01:25:13.595429+0000","last_became_peered":"2026-02-13T01:25:13.595429+0000","last_unstale":"2026-02-13T01:25:14.947360+0000","last_undegraded":"2026-02-13T01:25:14.947360+0000","last_fullsized":"2026-02-13T01:25:14.947360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:03.129382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947864+0000","last_change":"2026-02-13T01:25:13.596331+0000","last_active":"2026-02-13T01:25:14.947864+0000","last_peered":"2026-02-13T01:25:14.947864+0000","last_clean":"2026-02-13T01:25:14.947864+0000","last_became_active":"2026-02-13T01:25:13.596110+0000","last_became_peered":"2026-02-13T01:25:13.596110+0000","last_unstale":"2026-02-13T01:25:14.947864+0000","last_undegraded":"2026-02-13T01:25:14.947864+0000","last_fullsized":"2026-02-13T01:25:14.947864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:48:05.074653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704961+0000","last_change":"2026-02-13T01:25:13.599783+0000","last_active":"2026-02-13T01:25:14.704961+0000","last_peered":"2026-02-13T01:25:14.704961+0000","last_clean":"2026-02-13T01:25:14.704961+0000","last_became_active":"2026-02-13T01:25:13.599599+0000","last_became_peered":"2026-02-13T01:25:13.599599+0000","last_unstale":"2026-02-13T01:25:14.704961+0000","last_undegraded":"2026-02-13T01:25:14.704961+0000","last_fullsized":"2026-02-13T01:25:14.704961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:50.944319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704908+0000","last_change":"2026-02-13T01:25:13.600374+0000","last_active":"2026-02-13T01:25:14.704908+0000","last_peered":"2026-02-13T01:25:14.704908+0000","last_clean":"2026-02-13T01:25:14.704908+0000","last_became_active":"2026-02-13T01:25:13.600257+0000","last_became_peered":"2026-02-13T01:25:13.600257+0000","last_unstale":"2026-02-13T01:25:14.704908+0000","last_undegraded":"2026-02-13T01:25:14.704908+0000","last_fullsized":"2026-02-13T01:25:14.704908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:53:52.750448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946738+0000","last_change":"2026-02-13T01:25:13.600258+0000","last_active":"2026-02-13T01:25:14.946738+0000","last_peered":"2026-02-13T01:25:14.946738+0000","last_clean":"2026-02-13T01:25:14.946738+0000","last_became_active":"2026-02-13T01:25:13.599763+0000","last_became_peered":"2026-02-13T01:25:13.599763+0000","last_unstale":"2026-02-13T01:25:14.946738+0000","last_undegraded":"2026-02-13T01:25:14.946738+0000","last_fullsized":"2026-02-13T01:25:14.946738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:36:19.768078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946614+0000","last_change":"2026-02-13T01:25:13.598638+0000","last_active":"2026-02-13T01:25:14.946614+0000","last_peered":"2026-02-13T01:25:14.946614+0000","last_clean":"2026-02-13T01:25:14.946614+0000","last_became_active":"2026-02-13T01:25:13.598461+0000","last_became_peered":"2026-02-13T01:25:13.598461+0000","last_unstale":"2026-02-13T01:25:14.946614+0000","last_undegraded":"2026-02-13T01:25:14.946614+0000","last_fullsized":"2026-02-13T01:25:14.946614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:01.237039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596898+0000","last_change":"2026-02-13T01:25:13.599839+0000","last_active":"2026-02-13T01:25:14.596898+0000","last_peered":"2026-02-13T01:25:14.596898+0000","last_clean":"2026-02-13T01:25:14.596898+0000","last_became_active":"2026-02-13T01:25:13.599737+0000","last_became_peered":"2026-02-13T01:25:13.599737+0000","last_unstale":"2026-02-13T01:25:14.596898+0000","last_undegraded":"2026-02-13T01:25:14.596898+0000","last_fullsized":"2026-02-13T01:25:14.596898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:20.073558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595558+0000","last_change":"2026-02-13T01:25:13.596751+0000","last_active":"2026-02-13T01:25:14.595558+0000","last_peered":"2026-02-13T01:25:14.595558+0000","last_clean":"2026-02-13T01:25:14.595558+0000","last_became_active":"2026-02-13T01:25:13.596474+0000","last_became_peered":"2026-02-13T01:25:13.596474+0000","last_unstale":"2026-02-13T01:25:14.595558+0000","last_undegraded":"2026-02-13T01:25:14.595558+0000","last_fullsized":"2026-02-13T01:25:14.595558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:56.315292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946409+0000","last_change":"2026-02-13T01:25:13.595598+0000","last_active":"2026-02-13T01:25:14.946409+0000","last_peered":"2026-02-13T01:25:14.946409+0000","last_clean":"2026-02-13T01:25:14.946409+0000","last_became_active":"2026-02-13T01:25:13.595259+0000","last_became_peered":"2026-02-13T01:25:13.595259+0000","last_unstale":"2026-02-13T01:25:14.946409+0000","last_undegraded":"2026-02-13T01:25:14.946409+0000","last_fullsized":"2026-02-13T01:25:14.946409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:05:25.060881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947819+0000","last_change":"2026-02-13T01:25:13.597356+0000","last_active":"2026-02-13T01:25:14.947819+0000","last_peered":"2026-02-13T01:25:14.947819+0000","last_clean":"2026-02-13T01:25:14.947819+0000","last_became_active":"2026-02-13T01:25:13.597245+0000","last_became_peered":"2026-02-13T01:25:13.597245+0000","last_unstale":"2026-02-13T01:25:14.947819+0000","last_undegraded":"2026-02-13T01:25:14.947819+0000","last_fullsized":"2026-02-13T01:25:14.947819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:58.602043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947021+0000","last_change":"2026-02-13T01:25:13.599295+0000","last_active":"2026-02-13T01:25:14.947021+0000","last_peered":"2026-02-13T01:25:14.947021+0000","last_clean":"2026-02-13T01:25:14.947021+0000","last_became_active":"2026-02-13T01:25:13.599011+0000","last_became_peered":"2026-02-13T01:25:13.599011+0000","last_unstale":"2026-02-13T01:25:14.947021+0000","last_undegraded":"2026-02-13T01:25:14.947021+0000","last_fullsized":"2026-02-13T01:25:14.947021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:03.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947811+0000","last_change":"2026-02-13T01:25:13.596927+0000","last_active":"2026-02-13T01:25:14.947811+0000","last_peered":"2026-02-13T01:25:14.947811+0000","last_clean":"2026-02-13T01:25:14.947811+0000","last_became_active":"2026-02-13T01:25:13.596694+0000","last_became_peered":"2026-02-13T01:25:13.596694+0000","last_unstale":"2026-02-13T01:25:14.947811+0000","last_undegraded":"2026-02-13T01:25:14.947811+0000","last_fullsized":"2026-02-13T01:25:14.947811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:12.958466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946697+0000","last_change":"2026-02-13T01:25:13.597186+0000","last_active":"2026-02-13T01:25:14.946697+0000","last_peered":"2026-02-13T01:25:14.946697+0000","last_clean":"2026-02-13T01:25:14.946697+0000","last_became_active":"2026-02-13T01:25:13.596845+0000","last_became_peered":"2026-02-13T01:25:13.596845+0000","last_unstale":"2026-02-13T01:25:14.946697+0000","last_undegraded":"2026-02-13T01:25:14.946697+0000","last_fullsized":"2026-02-13T01:25:14.946697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:50:15.787511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.948073+0000","last_change":"2026-02-13T01:25:13.598968+0000","last_active":"2026-02-13T01:25:14.948073+0000","last_peered":"2026-02-13T01:25:14.948073+0000","last_clean":"2026-02-13T01:25:14.948073+0000","last_became_active":"2026-02-13T01:25:13.598579+0000","last_became_peered":"2026-02-13T01:25:13.598579+0000","last_unstale":"2026-02-13T01:25:14.948073+0000","last_undegraded":"2026-02-13T01:25:14.948073+0000","last_fullsized":"2026-02-13T01:25:14.948073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:45:49.051626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595617+0000","last_change":"2026-02-13T01:25:13.598068+0000","last_active":"2026-02-13T01:25:14.595617+0000","last_peered":"2026-02-13T01:25:14.595617+0000","last_clean":"2026-02-13T01:25:14.595617+0000","last_became_active":"2026-02-13T01:25:13.597724+0000","last_became_peered":"2026-02-13T01:25:13.597724+0000","last_unstale":"2026-02-13T01:25:14.595617+0000","last_undegraded":"2026-02-13T01:25:14.595617+0000","last_fullsized":"2026-02-13T01:25:14.595617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:48.542392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946412+0000","last_change":"2026-02-13T01:25:13.594807+0000","last_active":"2026-02-13T01:25:14.946412+0000","last_peered":"2026-02-13T01:25:14.946412+0000","last_clean":"2026-02-13T01:25:14.946412+0000","last_became_active":"2026-02-13T01:25:13.594367+0000","last_became_peered":"2026-02-13T01:25:13.594367+0000","last_unstale":"2026-02-13T01:25:14.946412+0000","last_undegraded":"2026-02-13T01:25:14.946412+0000","last_fullsized":"2026-02-13T01:25:14.946412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:03.116695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947861+0000","last_change":"2026-02-13T01:25:13.595823+0000","last_active":"2026-02-13T01:25:14.947861+0000","last_peered":"2026-02-13T01:25:14.947861+0000","last_clean":"2026-02-13T01:25:14.947861+0000","last_became_active":"2026-02-13T01:25:13.595587+0000","last_became_peered":"2026-02-13T01:25:13.595587+0000","last_unstale":"2026-02-13T01:25:14.947861+0000","last_undegraded":"2026-02-13T01:25:14.947861+0000","last_fullsized":"2026-02-13T01:25:14.947861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:57:11.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704994+0000","last_change":"2026-02-13T01:25:13.596901+0000","last_active":"2026-02-13T01:25:14.704994+0000","last_peered":"2026-02-13T01:25:14.704994+0000","last_clean":"2026-02-13T01:25:14.704994+0000","last_became_active":"2026-02-13T01:25:13.596699+0000","last_became_peered":"2026-02-13T01:25:13.596699+0000","last_unstale":"2026-02-13T01:25:14.704994+0000","last_undegraded":"2026-02-13T01:25:14.704994+0000","last_fullsized":"2026-02-13T01:25:14.704994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:48.582092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595169+0000","last_change":"2026-02-13T01:25:13.596471+0000","last_active":"2026-02-13T01:25:14.595169+0000","last_peered":"2026-02-13T01:25:14.595169+0000","last_clean":"2026-02-13T01:25:14.595169+0000","last_became_active":"2026-02-13T01:25:13.596238+0000","last_became_peered":"2026-02-13T01:25:13.596238+0000","last_unstale":"2026-02-13T01:25:14.595169+0000","last_undegraded":"2026-02-13T01:25:14.595169+0000","last_fullsized":"2026-02-13T01:25:14.595169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:05:24.893159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595418+0000","last_change":"2026-02-13T01:25:13.597034+0000","last_active":"2026-02-13T01:25:14.595418+0000","last_peered":"2026-02-13T01:25:14.595418+0000","last_clean":"2026-02-13T01:25:14.595418+0000","last_became_active":"2026-02-13T01:25:13.596573+0000","last_became_peered":"2026-02-13T01:25:13.596573+0000","last_unstale":"2026-02-13T01:25:14.595418+0000","last_undegraded":"2026-02-13T01:25:14.595418+0000","last_fullsized":"2026-02-13T01:25:14.595418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:49:51.020546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946112+0000","last_change":"2026-02-13T01:25:13.594615+0000","last_active":"2026-02-13T01:25:14.946112+0000","last_peered":"2026-02-13T01:25:14.946112+0000","last_clean":"2026-02-13T01:25:14.946112+0000","last_became_active":"2026-02-13T01:25:13.594349+0000","last_became_peered":"2026-02-13T01:25:13.594349+0000","last_unstale":"2026-02-13T01:25:14.946112+0000","last_undegraded":"2026-02-13T01:25:14.946112+0000","last_fullsized":"2026-02-13T01:25:14.946112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:03.697709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595137+0000","last_change":"2026-02-13T01:25:13.595949+0000","last_active":"2026-02-13T01:25:14.595137+0000","last_peered":"2026-02-13T01:25:14.595137+0000","last_clean":"2026-02-13T01:25:14.595137+0000","last_became_active":"2026-02-13T01:25:13.595183+0000","last_became_peered":"2026-02-13T01:25:13.595183+0000","last_unstale":"2026-02-13T01:25:14.595137+0000","last_undegraded":"2026-02-13T01:25:14.595137+0000","last_fullsized":"2026-02-13T01:25:14.595137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:36.191774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:20.603256+0000","last_change":"2026-02-13T01:25:12.586512+0000","last_active":"2026-02-13T01:25:20.603256+0000","last_peered":"2026-02-13T01:25:20.603256+0000","last_clean":"2026-02-13T01:25:20.603256+0000","last_became_active":"2026-02-13T01:25:12.586332+0000","last_became_peered":"2026-02-13T01:25:12.586332+0000","last_unstale":"2026-02-13T01:25:20.603256+0000","last_undegraded":"2026-02-13T01:25:20.603256+0000","last_fullsized":"2026-02-13T01:25:20.603256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:04.971228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946750+0000","last_change":"2026-02-13T01:25:13.596348+0000","last_active":"2026-02-13T01:25:14.946750+0000","last_peered":"2026-02-13T01:25:14.946750+0000","last_clean":"2026-02-13T01:25:14.946750+0000","last_became_active":"2026-02-13T01:25:13.596143+0000","last_became_peered":"2026-02-13T01:25:13.596143+0000","last_unstale":"2026-02-13T01:25:14.946750+0000","last_undegraded":"2026-02-13T01:25:14.946750+0000","last_fullsized":"2026-02-13T01:25:14.946750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:49:34.818946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.614769+0000","last_change":"2026-02-13T01:25:12.583872+0000","last_active":"2026-02-13T01:25:17.614769+0000","last_peered":"2026-02-13T01:25:17.614769+0000","last_clean":"2026-02-13T01:25:17.614769+0000","last_became_active":"2026-02-13T01:25:12.583688+0000","last_became_peered":"2026-02-13T01:25:12.583688+0000","last_unstale":"2026-02-13T01:25:17.614769+0000","last_undegraded":"2026-02-13T01:25:17.614769+0000","last_fullsized":"2026-02-13T01:25:17.614769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:24:57.991039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.616292+0000","last_change":"2026-02-13T01:25:12.585552+0000","last_active":"2026-02-13T01:25:17.616292+0000","last_peered":"2026-02-13T01:25:17.616292+0000","last_clean":"2026-02-13T01:25:17.616292+0000","last_became_active":"2026-02-13T01:25:12.585237+0000","last_became_peered":"2026-02-13T01:25:12.585237+0000","last_unstale":"2026-02-13T01:25:17.616292+0000","last_undegraded":"2026-02-13T01:25:17.616292+0000","last_fullsized":"2026-02-13T01:25:17.616292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:48.661981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947943+0000","last_change":"2026-02-13T01:25:13.597739+0000","last_active":"2026-02-13T01:25:14.947943+0000","last_peered":"2026-02-13T01:25:14.947943+0000","last_clean":"2026-02-13T01:25:14.947943+0000","last_became_active":"2026-02-13T01:25:13.597579+0000","last_became_peered":"2026-02-13T01:25:13.597579+0000","last_unstale":"2026-02-13T01:25:14.947943+0000","last_undegraded":"2026-02-13T01:25:14.947943+0000","last_fullsized":"2026-02-13T01:25:14.947943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:34:45.020931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.609998+0000","last_change":"2026-02-13T01:25:12.586197+0000","last_active":"2026-02-13T01:25:19.609998+0000","last_peered":"2026-02-13T01:25:19.609998+0000","last_clean":"2026-02-13T01:25:19.609998+0000","last_became_active":"2026-02-13T01:25:12.585596+0000","last_became_peered":"2026-02-13T01:25:12.585596+0000","last_unstale":"2026-02-13T01:25:19.609998+0000","last_undegraded":"2026-02-13T01:25:19.609998+0000","last_fullsized":"2026-02-13T01:25:19.609998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:43:32.118426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596800+0000","last_change":"2026-02-13T01:25:13.597729+0000","last_active":"2026-02-13T01:25:14.596800+0000","last_peered":"2026-02-13T01:25:14.596800+0000","last_clean":"2026-02-13T01:25:14.596800+0000","last_became_active":"2026-02-13T01:25:13.597613+0000","last_became_peered":"2026-02-13T01:25:13.597613+0000","last_unstale":"2026-02-13T01:25:14.596800+0000","last_undegraded":"2026-02-13T01:25:14.596800+0000","last_fullsized":"2026-02-13T01:25:14.596800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:55:31.684388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612834+0000","last_change":"2026-02-13T01:25:12.586878+0000","last_active":"2026-02-13T01:25:16.612834+0000","last_peered":"2026-02-13T01:25:16.612834+0000","last_clean":"2026-02-13T01:25:16.612834+0000","last_became_active":"2026-02-13T01:25:12.586734+0000","last_became_peered":"2026-02-13T01:25:12.586734+0000","last_unstale":"2026-02-13T01:25:16.612834+0000","last_undegraded":"2026-02-13T01:25:16.612834+0000","last_fullsized":"2026-02-13T01:25:16.612834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:29:16.007641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947391+0000","last_change":"2026-02-13T01:25:13.599851+0000","last_active":"2026-02-13T01:25:14.947391+0000","last_peered":"2026-02-13T01:25:14.947391+0000","last_clean":"2026-02-13T01:25:14.947391+0000","last_became_active":"2026-02-13T01:25:13.599378+0000","last_became_peered":"2026-02-13T01:25:13.599378+0000","last_unstale":"2026-02-13T01:25:14.947391+0000","last_undegraded":"2026-02-13T01:25:14.947391+0000","last_fullsized":"2026-02-13T01:25:14.947391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:17.930220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.610800+0000","last_change":"2026-02-13T01:25:12.586174+0000","last_active":"2026-02-13T01:25:19.610800+0000","last_peered":"2026-02-13T01:25:19.610800+0000","last_clean":"2026-02-13T01:25:19.610800+0000","last_became_active":"2026-02-13T01:25:12.585898+0000","last_became_peered":"2026-02-13T01:25:12.585898+0000","last_unstale":"2026-02-13T01:25:19.610800+0000","last_undegraded":"2026-02-13T01:25:19.610800+0000","last_fullsized":"2026-02-13T01:25:19.610800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:50:48.499836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.705016+0000","last_change":"2026-02-13T01:25:13.599679+0000","last_active":"2026-02-13T01:25:14.705016+0000","last_peered":"2026-02-13T01:25:14.705016+0000","last_clean":"2026-02-13T01:25:14.705016+0000","last_became_active":"2026-02-13T01:25:13.599505+0000","last_became_peered":"2026-02-13T01:25:13.599505+0000","last_unstale":"2026-02-13T01:25:14.705016+0000","last_undegraded":"2026-02-13T01:25:14.705016+0000","last_fullsized":"2026-02-13T01:25:14.705016+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:20:55.098705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.601443+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:18.601443+0000","last_peered":"2026-02-13T01:25:18.601443+0000","last_clean":"2026-02-13T01:25:18.601443+0000","last_became_active":"2026-02-13T01:25:12.584983+0000","last_became_peered":"2026-02-13T01:25:12.584983+0000","last_unstale":"2026-02-13T01:25:18.601443+0000","last_undegraded":"2026-02-13T01:25:18.601443+0000","last_fullsized":"2026-02-13T01:25:18.601443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:19:34.247623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947080+0000","last_change":"2026-02-13T01:25:13.600875+0000","last_active":"2026-02-13T01:25:14.947080+0000","last_peered":"2026-02-13T01:25:14.947080+0000","last_clean":"2026-02-13T01:25:14.947080+0000","last_became_active":"2026-02-13T01:25:13.600022+0000","last_became_peered":"2026-02-13T01:25:13.600022+0000","last_unstale":"2026-02-13T01:25:14.947080+0000","last_undegraded":"2026-02-13T01:25:14.947080+0000","last_fullsized":"2026-02-13T01:25:14.947080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:12.241807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612270+0000","last_change":"2026-02-13T01:25:12.585602+0000","last_active":"2026-02-13T01:25:16.612270+0000","last_peered":"2026-02-13T01:25:16.612270+0000","last_clean":"2026-02-13T01:25:16.612270+0000","last_became_active":"2026-02-13T01:25:12.585421+0000","last_became_peered":"2026-02-13T01:25:12.585421+0000","last_unstale":"2026-02-13T01:25:16.612270+0000","last_undegraded":"2026-02-13T01:25:16.612270+0000","last_fullsized":"2026-02-13T01:25:16.612270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:42.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595693+0000","last_change":"2026-02-13T01:25:13.595983+0000","last_active":"2026-02-13T01:25:14.595693+0000","last_peered":"2026-02-13T01:25:14.595693+0000","last_clean":"2026-02-13T01:25:14.595693+0000","last_became_active":"2026-02-13T01:25:13.594518+0000","last_became_peered":"2026-02-13T01:25:13.594518+0000","last_unstale":"2026-02-13T01:25:14.595693+0000","last_undegraded":"2026-02-13T01:25:14.595693+0000","last_fullsized":"2026-02-13T01:25:14.595693+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:16.951050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.609905+0000","last_change":"2026-02-13T01:25:12.585520+0000","last_active":"2026-02-13T01:25:19.609905+0000","last_peered":"2026-02-13T01:25:19.609905+0000","last_clean":"2026-02-13T01:25:19.609905+0000","last_became_active":"2026-02-13T01:25:12.584720+0000","last_became_peered":"2026-02-13T01:25:12.584720+0000","last_unstale":"2026-02-13T01:25:19.609905+0000","last_undegraded":"2026-02-13T01:25:19.609905+0000","last_fullsized":"2026-02-13T01:25:19.609905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:52.811064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947738+0000","last_change":"2026-02-13T01:25:13.597736+0000","last_active":"2026-02-13T01:25:14.947738+0000","last_peered":"2026-02-13T01:25:14.947738+0000","last_clean":"2026-02-13T01:25:14.947738+0000","last_became_active":"2026-02-13T01:25:13.597635+0000","last_became_peered":"2026-02-13T01:25:13.597635+0000","last_unstale":"2026-02-13T01:25:14.947738+0000","last_undegraded":"2026-02-13T01:25:14.947738+0000","last_fullsized":"2026-02-13T01:25:14.947738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:09.718614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.609997+0000","last_change":"2026-02-13T01:25:12.585611+0000","last_active":"2026-02-13T01:25:19.609997+0000","last_peered":"2026-02-13T01:25:19.609997+0000","last_clean":"2026-02-13T01:25:19.609997+0000","last_became_active":"2026-02-13T01:25:12.585213+0000","last_became_peered":"2026-02-13T01:25:12.585213+0000","last_unstale":"2026-02-13T01:25:19.609997+0000","last_undegraded":"2026-02-13T01:25:19.609997+0000","last_fullsized":"2026-02-13T01:25:19.609997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:58.518168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932699+0000","last_change":"2026-02-13T01:25:13.596481+0000","last_active":"2026-02-13T01:25:14.932699+0000","last_peered":"2026-02-13T01:25:14.932699+0000","last_clean":"2026-02-13T01:25:14.932699+0000","last_became_active":"2026-02-13T01:25:13.596188+0000","last_became_peered":"2026-02-13T01:25:13.596188+0000","last_unstale":"2026-02-13T01:25:14.932699+0000","last_undegraded":"2026-02-13T01:25:14.932699+0000","last_fullsized":"2026-02-13T01:25:14.932699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:31.070201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.605912+0000","last_change":"2026-02-13T01:25:12.585557+0000","last_active":"2026-02-13T01:25:18.605912+0000","last_peered":"2026-02-13T01:25:18.605912+0000","last_clean":"2026-02-13T01:25:18.605912+0000","last_became_active":"2026-02-13T01:25:12.585406+0000","last_became_peered":"2026-02-13T01:25:12.585406+0000","last_unstale":"2026-02-13T01:25:18.605912+0000","last_undegraded":"2026-02-13T01:25:18.605912+0000","last_fullsized":"2026-02-13T01:25:18.605912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:27.444543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932354+0000","last_change":"2026-02-13T01:25:13.596633+0000","last_active":"2026-02-13T01:25:14.932354+0000","last_peered":"2026-02-13T01:25:14.932354+0000","last_clean":"2026-02-13T01:25:14.932354+0000","last_became_active":"2026-02-13T01:25:13.596408+0000","last_became_peered":"2026-02-13T01:25:13.596408+0000","last_unstale":"2026-02-13T01:25:14.932354+0000","last_undegraded":"2026-02-13T01:25:14.932354+0000","last_fullsized":"2026-02-13T01:25:14.932354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:04:43.368134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.615219+0000","last_change":"2026-02-13T01:25:12.585798+0000","last_active":"2026-02-13T01:25:17.615219+0000","last_peered":"2026-02-13T01:25:17.615219+0000","last_clean":"2026-02-13T01:25:17.615219+0000","last_became_active":"2026-02-13T01:25:12.585641+0000","last_became_peered":"2026-02-13T01:25:12.585641+0000","last_unstale":"2026-02-13T01:25:17.615219+0000","last_undegraded":"2026-02-13T01:25:17.615219+0000","last_fullsized":"2026-02-13T01:25:17.615219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:16:39.636368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946456+0000","last_change":"2026-02-13T01:25:13.598371+0000","last_active":"2026-02-13T01:25:14.946456+0000","last_peered":"2026-02-13T01:25:14.946456+0000","last_clean":"2026-02-13T01:25:14.946456+0000","last_became_active":"2026-02-13T01:25:13.598256+0000","last_became_peered":"2026-02-13T01:25:13.598256+0000","last_unstale":"2026-02-13T01:25:14.946456+0000","last_undegraded":"2026-02-13T01:25:14.946456+0000","last_fullsized":"2026-02-13T01:25:14.946456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:55:02.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595836+0000","last_change":"2026-02-13T01:25:12.585124+0000","last_active":"2026-02-13T01:25:14.595836+0000","last_peered":"2026-02-13T01:25:14.595836+0000","last_clean":"2026-02-13T01:25:14.595836+0000","last_became_active":"2026-02-13T01:25:12.584899+0000","last_became_peered":"2026-02-13T01:25:12.584899+0000","last_unstale":"2026-02-13T01:25:14.595836+0000","last_undegraded":"2026-02-13T01:25:14.595836+0000","last_fullsized":"2026-02-13T01:25:14.595836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:20.160445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946480+0000","last_change":"2026-02-13T01:25:13.594139+0000","last_active":"2026-02-13T01:25:14.946480+0000","last_peered":"2026-02-13T01:25:14.946480+0000","last_clean":"2026-02-13T01:25:14.946480+0000","last_became_active":"2026-02-13T01:25:13.593871+0000","last_became_peered":"2026-02-13T01:25:13.593871+0000","last_unstale":"2026-02-13T01:25:14.946480+0000","last_undegraded":"2026-02-13T01:25:14.946480+0000","last_fullsized":"2026-02-13T01:25:14.946480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:27.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947888+0000","last_change":"2026-02-13T01:25:12.587190+0000","last_active":"2026-02-13T01:25:14.947888+0000","last_peered":"2026-02-13T01:25:14.947888+0000","last_clean":"2026-02-13T01:25:14.947888+0000","last_became_active":"2026-02-13T01:25:12.586934+0000","last_became_peered":"2026-02-13T01:25:12.586934+0000","last_unstale":"2026-02-13T01:25:14.947888+0000","last_undegraded":"2026-02-13T01:25:14.947888+0000","last_fullsized":"2026-02-13T01:25:14.947888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:59.367266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932714+0000","last_change":"2026-02-13T01:25:13.597938+0000","last_active":"2026-02-13T01:25:14.932714+0000","last_peered":"2026-02-13T01:25:14.932714+0000","last_clean":"2026-02-13T01:25:14.932714+0000","last_became_active":"2026-02-13T01:25:13.597812+0000","last_became_peered":"2026-02-13T01:25:13.597812+0000","last_unstale":"2026-02-13T01:25:14.932714+0000","last_undegraded":"2026-02-13T01:25:14.932714+0000","last_fullsized":"2026-02-13T01:25:14.932714+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:13.982549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.604675+0000","last_change":"2026-02-13T01:25:12.585792+0000","last_active":"2026-02-13T01:25:18.604675+0000","last_peered":"2026-02-13T01:25:18.604675+0000","last_clean":"2026-02-13T01:25:18.604675+0000","last_became_active":"2026-02-13T01:25:12.584980+0000","last_became_peered":"2026-02-13T01:25:12.584980+0000","last_unstale":"2026-02-13T01:25:18.604675+0000","last_undegraded":"2026-02-13T01:25:18.604675+0000","last_fullsized":"2026-02-13T01:25:18.604675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:44.806719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:15.931736+0000","last_change":"2026-02-13T01:25:13.597068+0000","last_active":"2026-02-13T01:25:15.931736+0000","last_peered":"2026-02-13T01:25:15.931736+0000","last_clean":"2026-02-13T01:25:15.931736+0000","last_became_active":"2026-02-13T01:25:13.596764+0000","last_became_peered":"2026-02-13T01:25:13.596764+0000","last_unstale":"2026-02-13T01:25:15.931736+0000","last_undegraded":"2026-02-13T01:25:15.931736+0000","last_fullsized":"2026-02-13T01:25:15.931736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:04.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.605529+0000","last_change":"2026-02-13T01:25:12.587494+0000","last_active":"2026-02-13T01:25:18.605529+0000","last_peered":"2026-02-13T01:25:18.605529+0000","last_clean":"2026-02-13T01:25:18.605529+0000","last_became_active":"2026-02-13T01:25:12.587302+0000","last_became_peered":"2026-02-13T01:25:12.587302+0000","last_unstale":"2026-02-13T01:25:18.605529+0000","last_undegraded":"2026-02-13T01:25:18.605529+0000","last_fullsized":"2026-02-13T01:25:18.605529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:35.215432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932713+0000","last_change":"2026-02-13T01:25:13.599446+0000","last_active":"2026-02-13T01:25:14.932713+0000","last_peered":"2026-02-13T01:25:14.932713+0000","last_clean":"2026-02-13T01:25:14.932713+0000","last_became_active":"2026-02-13T01:25:13.599198+0000","last_became_peered":"2026-02-13T01:25:13.599198+0000","last_unstale":"2026-02-13T01:25:14.932713+0000","last_undegraded":"2026-02-13T01:25:14.932713+0000","last_fullsized":"2026-02-13T01:25:14.932713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:43.435619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932277+0000","last_change":"2026-02-13T01:24:51.184559+0000","last_active":"2026-02-13T01:25:14.932277+0000","last_peered":"2026-02-13T01:25:14.932277+0000","last_clean":"2026-02-13T01:25:14.932277+0000","last_became_active":"2026-02-13T01:24:51.184384+0000","last_became_peered":"2026-02-13T01:24:51.184384+0000","last_unstale":"2026-02-13T01:25:14.932277+0000","last_undegraded":"2026-02-13T01:25:14.932277+0000","last_fullsized":"2026-02-13T01:25:14.932277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_clean_scrub_stamp":"2026-02-13T01:23:51.893115+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:29.993013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.605778+0000","last_change":"2026-02-13T01:25:12.585065+0000","last_active":"2026-02-13T01:25:18.605778+0000","last_peered":"2026-02-13T01:25:18.605778+0000","last_clean":"2026-02-13T01:25:18.605778+0000","last_became_active":"2026-02-13T01:25:12.584714+0000","last_became_peered":"2026-02-13T01:25:12.584714+0000","last_unstale":"2026-02-13T01:25:18.605778+0000","last_undegraded":"2026-02-13T01:25:18.605778+0000","last_fullsized":"2026-02-13T01:25:18.605778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:38.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.948072+0000","last_change":"2026-02-13T01:25:13.600026+0000","last_active":"2026-02-13T01:25:14.948072+0000","last_peered":"2026-02-13T01:25:14.948072+0000","last_clean":"2026-02-13T01:25:14.948072+0000","last_became_active":"2026-02-13T01:25:13.599911+0000","last_became_peered":"2026-02-13T01:25:13.599911+0000","last_unstale":"2026-02-13T01:25:14.948072+0000","last_undegraded":"2026-02-13T01:25:14.948072+0000","last_fullsized":"2026-02-13T01:25:14.948072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:32.272988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.615815+0000","last_change":"2026-02-13T01:25:12.586863+0000","last_active":"2026-02-13T01:25:17.615815+0000","last_peered":"2026-02-13T01:25:17.615815+0000","last_clean":"2026-02-13T01:25:17.615815+0000","last_became_active":"2026-02-13T01:25:12.586695+0000","last_became_peered":"2026-02-13T01:25:12.586695+0000","last_unstale":"2026-02-13T01:25:17.615815+0000","last_undegraded":"2026-02-13T01:25:17.615815+0000","last_fullsized":"2026-02-13T01:25:17.615815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:32.822119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947679+0000","last_change":"2026-02-13T01:25:13.596332+0000","last_active":"2026-02-13T01:25:14.947679+0000","last_peered":"2026-02-13T01:25:14.947679+0000","last_clean":"2026-02-13T01:25:14.947679+0000","last_became_active":"2026-02-13T01:25:13.596177+0000","last_became_peered":"2026-02-13T01:25:13.596177+0000","last_unstale":"2026-02-13T01:25:14.947679+0000","last_undegraded":"2026-02-13T01:25:14.947679+0000","last_fullsized":"2026-02-13T01:25:14.947679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:12.653773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.616850+0000","last_change":"2026-02-13T01:25:12.584951+0000","last_active":"2026-02-13T01:25:17.616850+0000","last_peered":"2026-02-13T01:25:17.616850+0000","last_clean":"2026-02-13T01:25:17.616850+0000","last_became_active":"2026-02-13T01:25:12.584782+0000","last_became_peered":"2026-02-13T01:25:12.584782+0000","last_unstale":"2026-02-13T01:25:17.616850+0000","last_undegraded":"2026-02-13T01:25:17.616850+0000","last_fullsized":"2026-02-13T01:25:17.616850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:50:10.145512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946570+0000","last_change":"2026-02-13T01:25:13.595945+0000","last_active":"2026-02-13T01:25:14.946570+0000","last_peered":"2026-02-13T01:25:14.946570+0000","last_clean":"2026-02-13T01:25:14.946570+0000","last_became_active":"2026-02-13T01:25:13.595710+0000","last_became_peered":"2026-02-13T01:25:13.595710+0000","last_unstale":"2026-02-13T01:25:14.946570+0000","last_undegraded":"2026-02-13T01:25:14.946570+0000","last_fullsized":"2026-02-13T01:25:14.946570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:48:20.578618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:20.614244+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:20.614244+0000","last_peered":"2026-02-13T01:25:20.614244+0000","last_clean":"2026-02-13T01:25:20.614244+0000","last_became_active":"2026-02-13T01:25:12.584995+0000","last_became_peered":"2026-02-13T01:25:12.584995+0000","last_unstale":"2026-02-13T01:25:20.614244+0000","last_undegraded":"2026-02-13T01:25:20.614244+0000","last_fullsized":"2026-02-13T01:25:20.614244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:26.521420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596550+0000","last_change":"2026-02-13T01:25:13.599307+0000","last_active":"2026-02-13T01:25:14.596550+0000","last_peered":"2026-02-13T01:25:14.596550+0000","last_clean":"2026-02-13T01:25:14.596550+0000","last_became_active":"2026-02-13T01:25:13.599019+0000","last_became_peered":"2026-02-13T01:25:13.599019+0000","last_unstale":"2026-02-13T01:25:14.596550+0000","last_undegraded":"2026-02-13T01:25:14.596550+0000","last_fullsized":"2026-02-13T01:25:14.596550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:39.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:15.626219+0000","last_change":"2026-02-13T01:25:12.588474+0000","last_active":"2026-02-13T01:25:15.626219+0000","last_peered":"2026-02-13T01:25:15.626219+0000","last_clean":"2026-02-13T01:25:15.626219+0000","last_became_active":"2026-02-13T01:25:12.588114+0000","last_became_peered":"2026-02-13T01:25:12.588114+0000","last_unstale":"2026-02-13T01:25:15.626219+0000","last_undegraded":"2026-02-13T01:25:15.626219+0000","last_fullsized":"2026-02-13T01:25:15.626219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:18.579891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596601+0000","last_change":"2026-02-13T01:25:13.599386+0000","last_active":"2026-02-13T01:25:14.596601+0000","last_peered":"2026-02-13T01:25:14.596601+0000","last_clean":"2026-02-13T01:25:14.596601+0000","last_became_active":"2026-02-13T01:25:13.598797+0000","last_became_peered":"2026-02-13T01:25:13.598797+0000","last_unstale":"2026-02-13T01:25:14.596601+0000","last_undegraded":"2026-02-13T01:25:14.596601+0000","last_fullsized":"2026-02-13T01:25:14.596601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:47:41.920834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595862+0000","last_change":"2026-02-13T01:25:12.584149+0000","last_active":"2026-02-13T01:25:14.595862+0000","last_peered":"2026-02-13T01:25:14.595862+0000","last_clean":"2026-02-13T01:25:14.595862+0000","last_became_active":"2026-02-13T01:25:12.583192+0000","last_became_peered":"2026-02-13T01:25:12.583192+0000","last_unstale":"2026-02-13T01:25:14.595862+0000","last_undegraded":"2026-02-13T01:25:14.595862+0000","last_fullsized":"2026-02-13T01:25:14.595862+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:49.438788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947865+0000","last_change":"2026-02-13T01:25:13.596354+0000","last_active":"2026-02-13T01:25:14.947865+0000","last_peered":"2026-02-13T01:25:14.947865+0000","last_clean":"2026-02-13T01:25:14.947865+0000","last_became_active":"2026-02-13T01:25:13.596192+0000","last_became_peered":"2026-02-13T01:25:13.596192+0000","last_unstale":"2026-02-13T01:25:14.947865+0000","last_undegraded":"2026-02-13T01:25:14.947865+0000","last_fullsized":"2026-02-13T01:25:14.947865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:39:38.836223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.607870+0000","last_change":"2026-02-13T01:25:12.588331+0000","last_active":"2026-02-13T01:25:18.607870+0000","last_peered":"2026-02-13T01:25:18.607870+0000","last_clean":"2026-02-13T01:25:18.607870+0000","last_became_active":"2026-02-13T01:25:12.588071+0000","last_became_peered":"2026-02-13T01:25:12.588071+0000","last_unstale":"2026-02-13T01:25:18.607870+0000","last_undegraded":"2026-02-13T01:25:18.607870+0000","last_fullsized":"2026-02-13T01:25:18.607870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:35.866770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.948148+0000","last_change":"2026-02-13T01:25:13.598530+0000","last_active":"2026-02-13T01:25:14.948148+0000","last_peered":"2026-02-13T01:25:14.948148+0000","last_clean":"2026-02-13T01:25:14.948148+0000","last_became_active":"2026-02-13T01:25:13.598219+0000","last_became_peered":"2026-02-13T01:25:13.598219+0000","last_unstale":"2026-02-13T01:25:14.948148+0000","last_undegraded":"2026-02-13T01:25:14.948148+0000","last_fullsized":"2026-02-13T01:25:14.948148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:28:20.723555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612700+0000","last_change":"2026-02-13T01:25:12.588841+0000","last_active":"2026-02-13T01:25:16.612700+0000","last_peered":"2026-02-13T01:25:16.612700+0000","last_clean":"2026-02-13T01:25:16.612700+0000","last_became_active":"2026-02-13T01:25:12.588740+0000","last_became_peered":"2026-02-13T01:25:12.588740+0000","last_unstale":"2026-02-13T01:25:16.612700+0000","last_undegraded":"2026-02-13T01:25:16.612700+0000","last_fullsized":"2026-02-13T01:25:16.612700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:24.749019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704997+0000","last_change":"2026-02-13T01:25:13.599374+0000","last_active":"2026-02-13T01:25:14.704997+0000","last_peered":"2026-02-13T01:25:14.704997+0000","last_clean":"2026-02-13T01:25:14.704997+0000","last_became_active":"2026-02-13T01:25:13.599203+0000","last_became_peered":"2026-02-13T01:25:13.599203+0000","last_unstale":"2026-02-13T01:25:14.704997+0000","last_undegraded":"2026-02-13T01:25:14.704997+0000","last_fullsized":"2026-02-13T01:25:14.704997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.788063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612542+0000","last_change":"2026-02-13T01:25:12.586929+0000","last_active":"2026-02-13T01:25:16.612542+0000","last_peered":"2026-02-13T01:25:16.612542+0000","last_clean":"2026-02-13T01:25:16.612542+0000","last_became_active":"2026-02-13T01:25:12.586784+0000","last_became_peered":"2026-02-13T01:25:12.586784+0000","last_unstale":"2026-02-13T01:25:16.612542+0000","last_undegraded":"2026-02-13T01:25:16.612542+0000","last_fullsized":"2026-02-13T01:25:16.612542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:42.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.594901+0000","last_change":"2026-02-13T01:25:13.595662+0000","last_active":"2026-02-13T01:25:14.594901+0000","last_peered":"2026-02-13T01:25:14.594901+0000","last_clean":"2026-02-13T01:25:14.594901+0000","last_became_active":"2026-02-13T01:25:13.595175+0000","last_became_peered":"2026-02-13T01:25:13.595175+0000","last_unstale":"2026-02-13T01:25:14.594901+0000","last_undegraded":"2026-02-13T01:25:14.594901+0000","last_fullsized":"2026-02-13T01:25:14.594901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:55.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.614322+0000","last_change":"2026-02-13T01:25:12.585367+0000","last_active":"2026-02-13T01:25:16.614322+0000","last_peered":"2026-02-13T01:25:16.614322+0000","last_clean":"2026-02-13T01:25:16.614322+0000","last_became_active":"2026-02-13T01:25:12.585130+0000","last_became_peered":"2026-02-13T01:25:12.585130+0000","last_unstale":"2026-02-13T01:25:16.614322+0000","last_undegraded":"2026-02-13T01:25:16.614322+0000","last_fullsized":"2026-02-13T01:25:16.614322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:40.260699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946361+0000","last_change":"2026-02-13T01:25:13.595087+0000","last_active":"2026-02-13T01:25:14.946361+0000","last_peered":"2026-02-13T01:25:14.946361+0000","last_clean":"2026-02-13T01:25:14.946361+0000","last_became_active":"2026-02-13T01:25:13.594916+0000","last_became_peered":"2026-02-13T01:25:13.594916+0000","last_unstale":"2026-02-13T01:25:14.946361+0000","last_undegraded":"2026-02-13T01:25:14.946361+0000","last_fullsized":"2026-02-13T01:25:14.946361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:22:33.449950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.604847+0000","last_change":"2026-02-13T01:25:12.586261+0000","last_active":"2026-02-13T01:25:18.604847+0000","last_peered":"2026-02-13T01:25:18.604847+0000","last_clean":"2026-02-13T01:25:18.604847+0000","last_became_active":"2026-02-13T01:25:12.585946+0000","last_became_peered":"2026-02-13T01:25:12.585946+0000","last_unstale":"2026-02-13T01:25:18.604847+0000","last_undegraded":"2026-02-13T01:25:18.604847+0000","last_fullsized":"2026-02-13T01:25:18.604847+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:33.342624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947921+0000","last_change":"2026-02-13T01:25:13.597108+0000","last_active":"2026-02-13T01:25:14.947921+0000","last_peered":"2026-02-13T01:25:14.947921+0000","last_clean":"2026-02-13T01:25:14.947921+0000","last_became_active":"2026-02-13T01:25:13.596931+0000","last_became_peered":"2026-02-13T01:25:13.596931+0000","last_unstale":"2026-02-13T01:25:14.947921+0000","last_undegraded":"2026-02-13T01:25:14.947921+0000","last_fullsized":"2026-02-13T01:25:14.947921+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:17:57.428194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612288+0000","last_change":"2026-02-13T01:25:12.585506+0000","last_active":"2026-02-13T01:25:16.612288+0000","last_peered":"2026-02-13T01:25:16.612288+0000","last_clean":"2026-02-13T01:25:16.612288+0000","last_became_active":"2026-02-13T01:25:12.585015+0000","last_became_peered":"2026-02-13T01:25:12.585015+0000","last_unstale":"2026-02-13T01:25:16.612288+0000","last_undegraded":"2026-02-13T01:25:16.612288+0000","last_fullsized":"2026-02-13T01:25:16.612288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:35:07.130309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932671+0000","last_change":"2026-02-13T01:25:13.599415+0000","last_active":"2026-02-13T01:25:14.932671+0000","last_peered":"2026-02-13T01:25:14.932671+0000","last_clean":"2026-02-13T01:25:14.932671+0000","last_became_active":"2026-02-13T01:25:13.599143+0000","last_became_peered":"2026-02-13T01:25:13.599143+0000","last_unstale":"2026-02-13T01:25:14.932671+0000","last_undegraded":"2026-02-13T01:25:14.932671+0000","last_fullsized":"2026-02-13T01:25:14.932671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:31.271789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946890+0000","last_change":"2026-02-13T01:25:13.600494+0000","last_active":"2026-02-13T01:25:14.946890+0000","last_peered":"2026-02-13T01:25:14.946890+0000","last_clean":"2026-02-13T01:25:14.946890+0000","last_became_active":"2026-02-13T01:25:13.600302+0000","last_became_peered":"2026-02-13T01:25:13.600302+0000","last_unstale":"2026-02-13T01:25:14.946890+0000","last_undegraded":"2026-02-13T01:25:14.946890+0000","last_fullsized":"2026-02-13T01:25:14.946890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:50:25.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595462+0000","last_change":"2026-02-13T01:25:12.584795+0000","last_active":"2026-02-13T01:25:14.595462+0000","last_peered":"2026-02-13T01:25:14.595462+0000","last_clean":"2026-02-13T01:25:14.595462+0000","last_became_active":"2026-02-13T01:25:12.584392+0000","last_became_peered":"2026-02-13T01:25:12.584392+0000","last_unstale":"2026-02-13T01:25:14.595462+0000","last_undegraded":"2026-02-13T01:25:14.595462+0000","last_fullsized":"2026-02-13T01:25:14.595462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:47.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946947+0000","last_change":"2026-02-13T01:25:13.600631+0000","last_active":"2026-02-13T01:25:14.946947+0000","last_peered":"2026-02-13T01:25:14.946947+0000","last_clean":"2026-02-13T01:25:14.946947+0000","last_became_active":"2026-02-13T01:25:13.599642+0000","last_became_peered":"2026-02-13T01:25:13.599642+0000","last_unstale":"2026-02-13T01:25:14.946947+0000","last_undegraded":"2026-02-13T01:25:14.946947+0000","last_fullsized":"2026-02-13T01:25:14.946947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:03:02.974206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.614579+0000","last_change":"2026-02-13T01:25:12.584754+0000","last_active":"2026-02-13T01:25:17.614579+0000","last_peered":"2026-02-13T01:25:17.614579+0000","last_clean":"2026-02-13T01:25:17.614579+0000","last_became_active":"2026-02-13T01:25:12.584425+0000","last_became_peered":"2026-02-13T01:25:12.584425+0000","last_unstale":"2026-02-13T01:25:17.614579+0000","last_undegraded":"2026-02-13T01:25:17.614579+0000","last_fullsized":"2026-02-13T01:25:17.614579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:32:08.183856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.705004+0000","last_change":"2026-02-13T01:25:13.602615+0000","last_active":"2026-02-13T01:25:14.705004+0000","last_peered":"2026-02-13T01:25:14.705004+0000","last_clean":"2026-02-13T01:25:14.705004+0000","last_became_active":"2026-02-13T01:25:13.602511+0000","last_became_peered":"2026-02-13T01:25:13.602511+0000","last_unstale":"2026-02-13T01:25:14.705004+0000","last_undegraded":"2026-02-13T01:25:14.705004+0000","last_fullsized":"2026-02-13T01:25:14.705004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:27:59.716321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.948130+0000","last_change":"2026-02-13T01:25:12.588038+0000","last_active":"2026-02-13T01:25:14.948130+0000","last_peered":"2026-02-13T01:25:14.948130+0000","last_clean":"2026-02-13T01:25:14.948130+0000","last_became_active":"2026-02-13T01:25:12.587814+0000","last_became_peered":"2026-02-13T01:25:12.587814+0000","last_unstale":"2026-02-13T01:25:14.948130+0000","last_undegraded":"2026-02-13T01:25:14.948130+0000","last_fullsized":"2026-02-13T01:25:14.948130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:56.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.948039+0000","last_change":"2026-02-13T01:25:13.598388+0000","last_active":"2026-02-13T01:25:14.948039+0000","last_peered":"2026-02-13T01:25:14.948039+0000","last_clean":"2026-02-13T01:25:14.948039+0000","last_became_active":"2026-02-13T01:25:13.598128+0000","last_became_peered":"2026-02-13T01:25:13.598128+0000","last_unstale":"2026-02-13T01:25:14.948039+0000","last_undegraded":"2026-02-13T01:25:14.948039+0000","last_fullsized":"2026-02-13T01:25:14.948039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:42.080004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.612257+0000","last_change":"2026-02-13T01:25:12.587715+0000","last_active":"2026-02-13T01:25:19.612257+0000","last_peered":"2026-02-13T01:25:19.612257+0000","last_clean":"2026-02-13T01:25:19.612257+0000","last_became_active":"2026-02-13T01:25:12.587565+0000","last_became_peered":"2026-02-13T01:25:12.587565+0000","last_unstale":"2026-02-13T01:25:19.612257+0000","last_undegraded":"2026-02-13T01:25:19.612257+0000","last_fullsized":"2026-02-13T01:25:19.612257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:23:52.902150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8146,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":163,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":30501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138560,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":300107,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710727,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":394792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939655,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":986770,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":22358,"internal_metadata":27568298},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":394312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30563,"internal_metadata":27560093},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299402,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26841,"internal_metadata":27563815},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528333,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":987542,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33569,"internal_metadata":27557087},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":393258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888080,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":37,"kb_used_meta":26906,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":986832,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":38434,"internal_metadata":27552222},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018897,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":393834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40128,"internal_metadata":27550528},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247826,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":393362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44188,"internal_metadata":27546468},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":57,"kb_used_meta":26886,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":396796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59309,"internal_metadata":27531347},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607572,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":394802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":53,"kb_used_meta":26890,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":395800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55060,"internal_metadata":27535596},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11428,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":11199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20675,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7373,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19596,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8288,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8008,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10315,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8714,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23205,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14688,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4557,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:22.413 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:22.561 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:22.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/617536716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78115440 msgr2=0x7f7b78175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/617536716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78115440 0x7f7b78175de0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=9105927401753587106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b7400aa70 tx=0x7f7b7402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/617536716 shutdown_connections 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/617536716 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78115440 0x7f7b78175de0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=9105927401753587106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/617536716 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b7810fc20 0x7f7b78114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/617536716 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7b7810f230 0x7f7b7810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/617536716 >> 10.20.193.91:0/617536716 conn(0x7f7b780ecb30 msgr2=0x7f7b7810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/617536716 shutdown_connections 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/617536716 wait complete. 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 Processor -- start 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- start start 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7b7810f230 0x7f7b7811d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78115440 0x7f7b7811d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 0x7f7b78122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78123520 con 0x7f7b78122b10 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78123690 con 0x7f7b78115440 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.678+0000 7f7b7fef86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78123850 con 0x7f7b7810f230 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 0x7f7b78122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 0x7f7b78122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36662/0 (socket says 10.20.193.91:36662) 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 -- 10.20.193.91:0/4281280881 learned_addr learned my addr 10.20.193.91:0/4281280881 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7dc6d6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7b7810f230 0x7f7b7811d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7d46c6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78115440 0x7f7b7811d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 -- 10.20.193.91:0/4281280881 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7b7810f230 msgr2=0x7f7b7811d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7b7810f230 0x7f7b7811d210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 -- 10.20.193.91:0/4281280881 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78115440 msgr2=0x7f7b7811d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78115440 0x7f7b7811d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 -- 10.20.193.91:0/4281280881 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7400a660 con 0x7f7b78122b10 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7e46e6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 0x7f7b78122fb0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b740054b0 tx=0x7f7b740054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b74003a30 con 0x7f7b78122b10 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7b74003b90 con 0x7f7b78122b10 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b78163ca0 con 0x7f7b78122b10 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b740382f0 con 0x7f7b78122b10 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b781640d0 con 0x7f7b78122b10 2026-02-13T01:25:22.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.679+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b78110500 con 0x7f7b78122b10 2026-02-13T01:25:22.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.681+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7b74008260 con 0x7f7b78122b10 2026-02-13T01:25:22.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.682+0000 7f7b66ffd6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7b540b56e0 0x7f7b540d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:22.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.682+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7b74109160 con 0x7f7b78122b10 2026-02-13T01:25:22.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.682+0000 7f7b7dc6d6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7b540b56e0 0x7f7b540d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:22.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.682+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b740ce9b0 con 0x7f7b78122b10 2026-02-13T01:25:22.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.682+0000 7f7b7dc6d6c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7b540b56e0 0x7f7b540d5b90 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b68005980 tx=0x7f7b68005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:22.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.770+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b7811e360 con 0x7f7b540b56e0 2026-02-13T01:25:22.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.772+0000 7f7b66ffd6c0 1 -- 10.20.193.91:0/4281280881 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258975 (secure 0 0 0) 0x7f7b7811e360 con 0x7f7b540b56e0 2026-02-13T01:25:22.774 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:22.775 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7b540b56e0 msgr2=0x7f7b540d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7b540b56e0 0x7f7b540d5b90 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b68005980 tx=0x7f7b68005910 comp rx=0 tx=0).stop 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 msgr2=0x7f7b78122fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 0x7f7b78122fb0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b740054b0 tx=0x7f7b740054e0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 shutdown_connections 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7b540b56e0 0x7f7b540d5b90 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7b78122b10 0x7f7b78122fb0 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78115440 0x7f7b7811d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 --2- 10.20.193.91:0/4281280881 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7b7810f230 0x7f7b7811d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:22.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 >> 10.20.193.91:0/4281280881 conn(0x7f7b780ecb30 msgr2=0x7f7b7810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:22.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 shutdown_connections 2026-02-13T01:25:22.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:22.773+0000 7f7b7fef86c0 1 -- 10.20.193.91:0/4281280881 wait complete. 2026-02-13T01:25:22.813 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2026-02-13T01:25:22.628699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598631,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":139,"num_read_kb":119,"num_write":359,"num_write_kb":3771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333568,"kb_used_data":10000,"kb_used_omap":426,"kb_used_meta":322901,"kb_avail":8807704832,"statfs":{"total":9019431321600,"available":9019089747968,"internally_reserved":0,"allocated":10240000,"data_stored":6521197,"data_compressed":117292,"data_compressed_allocated":139264,"data_compressed_original":1777664,"omap_allocated":436540,"internal_metadata":330651332},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8263,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":164,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.032868"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946548+0000","last_change":"2026-02-13T01:25:13.598845+0000","last_active":"2026-02-13T01:25:14.946548+0000","last_peered":"2026-02-13T01:25:14.946548+0000","last_clean":"2026-02-13T01:25:14.946548+0000","last_became_active":"2026-02-13T01:25:13.598609+0000","last_became_peered":"2026-02-13T01:25:13.598609+0000","last_unstale":"2026-02-13T01:25:14.946548+0000","last_undegraded":"2026-02-13T01:25:14.946548+0000","last_fullsized":"2026-02-13T01:25:14.946548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:13.127033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.705009+0000","last_change":"2026-02-13T01:25:13.599778+0000","last_active":"2026-02-13T01:25:14.705009+0000","last_peered":"2026-02-13T01:25:14.705009+0000","last_clean":"2026-02-13T01:25:14.705009+0000","last_became_active":"2026-02-13T01:25:13.599585+0000","last_became_peered":"2026-02-13T01:25:13.599585+0000","last_unstale":"2026-02-13T01:25:14.705009+0000","last_undegraded":"2026-02-13T01:25:14.705009+0000","last_fullsized":"2026-02-13T01:25:14.705009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:23:42.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704951+0000","last_change":"2026-02-13T01:25:13.602206+0000","last_active":"2026-02-13T01:25:14.704951+0000","last_peered":"2026-02-13T01:25:14.704951+0000","last_clean":"2026-02-13T01:25:14.704951+0000","last_became_active":"2026-02-13T01:25:13.602099+0000","last_became_peered":"2026-02-13T01:25:13.602099+0000","last_unstale":"2026-02-13T01:25:14.704951+0000","last_undegraded":"2026-02-13T01:25:14.704951+0000","last_fullsized":"2026-02-13T01:25:14.704951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:31.903965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947207+0000","last_change":"2026-02-13T01:25:13.596389+0000","last_active":"2026-02-13T01:25:14.947207+0000","last_peered":"2026-02-13T01:25:14.947207+0000","last_clean":"2026-02-13T01:25:14.947207+0000","last_became_active":"2026-02-13T01:25:13.596165+0000","last_became_peered":"2026-02-13T01:25:13.596165+0000","last_unstale":"2026-02-13T01:25:14.947207+0000","last_undegraded":"2026-02-13T01:25:14.947207+0000","last_fullsized":"2026-02-13T01:25:14.947207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:43:09.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595157+0000","last_change":"2026-02-13T01:25:13.597387+0000","last_active":"2026-02-13T01:25:14.595157+0000","last_peered":"2026-02-13T01:25:14.595157+0000","last_clean":"2026-02-13T01:25:14.595157+0000","last_became_active":"2026-02-13T01:25:13.596351+0000","last_became_peered":"2026-02-13T01:25:13.596351+0000","last_unstale":"2026-02-13T01:25:14.595157+0000","last_undegraded":"2026-02-13T01:25:14.595157+0000","last_fullsized":"2026-02-13T01:25:14.595157+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:07:01.520823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596248+0000","last_change":"2026-02-13T01:25:13.595155+0000","last_active":"2026-02-13T01:25:14.596248+0000","last_peered":"2026-02-13T01:25:14.596248+0000","last_clean":"2026-02-13T01:25:14.596248+0000","last_became_active":"2026-02-13T01:25:13.594858+0000","last_became_peered":"2026-02-13T01:25:13.594858+0000","last_unstale":"2026-02-13T01:25:14.596248+0000","last_undegraded":"2026-02-13T01:25:14.596248+0000","last_fullsized":"2026-02-13T01:25:14.596248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:29:34.717120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932290+0000","last_change":"2026-02-13T01:25:13.596326+0000","last_active":"2026-02-13T01:25:14.932290+0000","last_peered":"2026-02-13T01:25:14.932290+0000","last_clean":"2026-02-13T01:25:14.932290+0000","last_became_active":"2026-02-13T01:25:13.595964+0000","last_became_peered":"2026-02-13T01:25:13.595964+0000","last_unstale":"2026-02-13T01:25:14.932290+0000","last_undegraded":"2026-02-13T01:25:14.932290+0000","last_fullsized":"2026-02-13T01:25:14.932290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:07:18.022160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.623695+0000","last_change":"2026-02-13T01:25:13.598247+0000","last_active":"2026-02-13T01:25:21.623695+0000","last_peered":"2026-02-13T01:25:21.623695+0000","last_clean":"2026-02-13T01:25:21.623695+0000","last_became_active":"2026-02-13T01:25:13.598098+0000","last_became_peered":"2026-02-13T01:25:13.598098+0000","last_unstale":"2026-02-13T01:25:21.623695+0000","last_undegraded":"2026-02-13T01:25:21.623695+0000","last_fullsized":"2026-02-13T01:25:21.623695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:41.227689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947436+0000","last_change":"2026-02-13T01:25:13.601183+0000","last_active":"2026-02-13T01:25:14.947436+0000","last_peered":"2026-02-13T01:25:14.947436+0000","last_clean":"2026-02-13T01:25:14.947436+0000","last_became_active":"2026-02-13T01:25:13.600958+0000","last_became_peered":"2026-02-13T01:25:13.600958+0000","last_unstale":"2026-02-13T01:25:14.947436+0000","last_undegraded":"2026-02-13T01:25:14.947436+0000","last_fullsized":"2026-02-13T01:25:14.947436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:15:12.659724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596776+0000","last_change":"2026-02-13T01:25:13.595002+0000","last_active":"2026-02-13T01:25:14.596776+0000","last_peered":"2026-02-13T01:25:14.596776+0000","last_clean":"2026-02-13T01:25:14.596776+0000","last_became_active":"2026-02-13T01:25:13.594709+0000","last_became_peered":"2026-02-13T01:25:13.594709+0000","last_unstale":"2026-02-13T01:25:14.596776+0000","last_undegraded":"2026-02-13T01:25:14.596776+0000","last_fullsized":"2026-02-13T01:25:14.596776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:42:01.732241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932637+0000","last_change":"2026-02-13T01:25:13.599426+0000","last_active":"2026-02-13T01:25:14.932637+0000","last_peered":"2026-02-13T01:25:14.932637+0000","last_clean":"2026-02-13T01:25:14.932637+0000","last_became_active":"2026-02-13T01:25:13.599121+0000","last_became_peered":"2026-02-13T01:25:13.599121+0000","last_unstale":"2026-02-13T01:25:14.932637+0000","last_undegraded":"2026-02-13T01:25:14.932637+0000","last_fullsized":"2026-02-13T01:25:14.932637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:43.625554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947360+0000","last_change":"2026-02-13T01:25:13.595569+0000","last_active":"2026-02-13T01:25:14.947360+0000","last_peered":"2026-02-13T01:25:14.947360+0000","last_clean":"2026-02-13T01:25:14.947360+0000","last_became_active":"2026-02-13T01:25:13.595429+0000","last_became_peered":"2026-02-13T01:25:13.595429+0000","last_unstale":"2026-02-13T01:25:14.947360+0000","last_undegraded":"2026-02-13T01:25:14.947360+0000","last_fullsized":"2026-02-13T01:25:14.947360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:03.129382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947864+0000","last_change":"2026-02-13T01:25:13.596331+0000","last_active":"2026-02-13T01:25:14.947864+0000","last_peered":"2026-02-13T01:25:14.947864+0000","last_clean":"2026-02-13T01:25:14.947864+0000","last_became_active":"2026-02-13T01:25:13.596110+0000","last_became_peered":"2026-02-13T01:25:13.596110+0000","last_unstale":"2026-02-13T01:25:14.947864+0000","last_undegraded":"2026-02-13T01:25:14.947864+0000","last_fullsized":"2026-02-13T01:25:14.947864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:48:05.074653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704961+0000","last_change":"2026-02-13T01:25:13.599783+0000","last_active":"2026-02-13T01:25:14.704961+0000","last_peered":"2026-02-13T01:25:14.704961+0000","last_clean":"2026-02-13T01:25:14.704961+0000","last_became_active":"2026-02-13T01:25:13.599599+0000","last_became_peered":"2026-02-13T01:25:13.599599+0000","last_unstale":"2026-02-13T01:25:14.704961+0000","last_undegraded":"2026-02-13T01:25:14.704961+0000","last_fullsized":"2026-02-13T01:25:14.704961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:50.944319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704908+0000","last_change":"2026-02-13T01:25:13.600374+0000","last_active":"2026-02-13T01:25:14.704908+0000","last_peered":"2026-02-13T01:25:14.704908+0000","last_clean":"2026-02-13T01:25:14.704908+0000","last_became_active":"2026-02-13T01:25:13.600257+0000","last_became_peered":"2026-02-13T01:25:13.600257+0000","last_unstale":"2026-02-13T01:25:14.704908+0000","last_undegraded":"2026-02-13T01:25:14.704908+0000","last_fullsized":"2026-02-13T01:25:14.704908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:53:52.750448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946738+0000","last_change":"2026-02-13T01:25:13.600258+0000","last_active":"2026-02-13T01:25:14.946738+0000","last_peered":"2026-02-13T01:25:14.946738+0000","last_clean":"2026-02-13T01:25:14.946738+0000","last_became_active":"2026-02-13T01:25:13.599763+0000","last_became_peered":"2026-02-13T01:25:13.599763+0000","last_unstale":"2026-02-13T01:25:14.946738+0000","last_undegraded":"2026-02-13T01:25:14.946738+0000","last_fullsized":"2026-02-13T01:25:14.946738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:36:19.768078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946614+0000","last_change":"2026-02-13T01:25:13.598638+0000","last_active":"2026-02-13T01:25:14.946614+0000","last_peered":"2026-02-13T01:25:14.946614+0000","last_clean":"2026-02-13T01:25:14.946614+0000","last_became_active":"2026-02-13T01:25:13.598461+0000","last_became_peered":"2026-02-13T01:25:13.598461+0000","last_unstale":"2026-02-13T01:25:14.946614+0000","last_undegraded":"2026-02-13T01:25:14.946614+0000","last_fullsized":"2026-02-13T01:25:14.946614+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:01.237039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596898+0000","last_change":"2026-02-13T01:25:13.599839+0000","last_active":"2026-02-13T01:25:14.596898+0000","last_peered":"2026-02-13T01:25:14.596898+0000","last_clean":"2026-02-13T01:25:14.596898+0000","last_became_active":"2026-02-13T01:25:13.599737+0000","last_became_peered":"2026-02-13T01:25:13.599737+0000","last_unstale":"2026-02-13T01:25:14.596898+0000","last_undegraded":"2026-02-13T01:25:14.596898+0000","last_fullsized":"2026-02-13T01:25:14.596898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:20.073558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595558+0000","last_change":"2026-02-13T01:25:13.596751+0000","last_active":"2026-02-13T01:25:14.595558+0000","last_peered":"2026-02-13T01:25:14.595558+0000","last_clean":"2026-02-13T01:25:14.595558+0000","last_became_active":"2026-02-13T01:25:13.596474+0000","last_became_peered":"2026-02-13T01:25:13.596474+0000","last_unstale":"2026-02-13T01:25:14.595558+0000","last_undegraded":"2026-02-13T01:25:14.595558+0000","last_fullsized":"2026-02-13T01:25:14.595558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:56.315292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946409+0000","last_change":"2026-02-13T01:25:13.595598+0000","last_active":"2026-02-13T01:25:14.946409+0000","last_peered":"2026-02-13T01:25:14.946409+0000","last_clean":"2026-02-13T01:25:14.946409+0000","last_became_active":"2026-02-13T01:25:13.595259+0000","last_became_peered":"2026-02-13T01:25:13.595259+0000","last_unstale":"2026-02-13T01:25:14.946409+0000","last_undegraded":"2026-02-13T01:25:14.946409+0000","last_fullsized":"2026-02-13T01:25:14.946409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:05:25.060881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947819+0000","last_change":"2026-02-13T01:25:13.597356+0000","last_active":"2026-02-13T01:25:14.947819+0000","last_peered":"2026-02-13T01:25:14.947819+0000","last_clean":"2026-02-13T01:25:14.947819+0000","last_became_active":"2026-02-13T01:25:13.597245+0000","last_became_peered":"2026-02-13T01:25:13.597245+0000","last_unstale":"2026-02-13T01:25:14.947819+0000","last_undegraded":"2026-02-13T01:25:14.947819+0000","last_fullsized":"2026-02-13T01:25:14.947819+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:58.602043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947021+0000","last_change":"2026-02-13T01:25:13.599295+0000","last_active":"2026-02-13T01:25:14.947021+0000","last_peered":"2026-02-13T01:25:14.947021+0000","last_clean":"2026-02-13T01:25:14.947021+0000","last_became_active":"2026-02-13T01:25:13.599011+0000","last_became_peered":"2026-02-13T01:25:13.599011+0000","last_unstale":"2026-02-13T01:25:14.947021+0000","last_undegraded":"2026-02-13T01:25:14.947021+0000","last_fullsized":"2026-02-13T01:25:14.947021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:03.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.623715+0000","last_change":"2026-02-13T01:25:13.596927+0000","last_active":"2026-02-13T01:25:21.623715+0000","last_peered":"2026-02-13T01:25:21.623715+0000","last_clean":"2026-02-13T01:25:21.623715+0000","last_became_active":"2026-02-13T01:25:13.596694+0000","last_became_peered":"2026-02-13T01:25:13.596694+0000","last_unstale":"2026-02-13T01:25:21.623715+0000","last_undegraded":"2026-02-13T01:25:21.623715+0000","last_fullsized":"2026-02-13T01:25:21.623715+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:12.958466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946697+0000","last_change":"2026-02-13T01:25:13.597186+0000","last_active":"2026-02-13T01:25:14.946697+0000","last_peered":"2026-02-13T01:25:14.946697+0000","last_clean":"2026-02-13T01:25:14.946697+0000","last_became_active":"2026-02-13T01:25:13.596845+0000","last_became_peered":"2026-02-13T01:25:13.596845+0000","last_unstale":"2026-02-13T01:25:14.946697+0000","last_undegraded":"2026-02-13T01:25:14.946697+0000","last_fullsized":"2026-02-13T01:25:14.946697+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:50:15.787511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.624123+0000","last_change":"2026-02-13T01:25:13.598968+0000","last_active":"2026-02-13T01:25:21.624123+0000","last_peered":"2026-02-13T01:25:21.624123+0000","last_clean":"2026-02-13T01:25:21.624123+0000","last_became_active":"2026-02-13T01:25:13.598579+0000","last_became_peered":"2026-02-13T01:25:13.598579+0000","last_unstale":"2026-02-13T01:25:21.624123+0000","last_undegraded":"2026-02-13T01:25:21.624123+0000","last_fullsized":"2026-02-13T01:25:21.624123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:45:49.051626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595617+0000","last_change":"2026-02-13T01:25:13.598068+0000","last_active":"2026-02-13T01:25:14.595617+0000","last_peered":"2026-02-13T01:25:14.595617+0000","last_clean":"2026-02-13T01:25:14.595617+0000","last_became_active":"2026-02-13T01:25:13.597724+0000","last_became_peered":"2026-02-13T01:25:13.597724+0000","last_unstale":"2026-02-13T01:25:14.595617+0000","last_undegraded":"2026-02-13T01:25:14.595617+0000","last_fullsized":"2026-02-13T01:25:14.595617+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:48.542392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946412+0000","last_change":"2026-02-13T01:25:13.594807+0000","last_active":"2026-02-13T01:25:14.946412+0000","last_peered":"2026-02-13T01:25:14.946412+0000","last_clean":"2026-02-13T01:25:14.946412+0000","last_became_active":"2026-02-13T01:25:13.594367+0000","last_became_peered":"2026-02-13T01:25:13.594367+0000","last_unstale":"2026-02-13T01:25:14.946412+0000","last_undegraded":"2026-02-13T01:25:14.946412+0000","last_fullsized":"2026-02-13T01:25:14.946412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:03.116695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947861+0000","last_change":"2026-02-13T01:25:13.595823+0000","last_active":"2026-02-13T01:25:14.947861+0000","last_peered":"2026-02-13T01:25:14.947861+0000","last_clean":"2026-02-13T01:25:14.947861+0000","last_became_active":"2026-02-13T01:25:13.595587+0000","last_became_peered":"2026-02-13T01:25:13.595587+0000","last_unstale":"2026-02-13T01:25:14.947861+0000","last_undegraded":"2026-02-13T01:25:14.947861+0000","last_fullsized":"2026-02-13T01:25:14.947861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:57:11.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704994+0000","last_change":"2026-02-13T01:25:13.596901+0000","last_active":"2026-02-13T01:25:14.704994+0000","last_peered":"2026-02-13T01:25:14.704994+0000","last_clean":"2026-02-13T01:25:14.704994+0000","last_became_active":"2026-02-13T01:25:13.596699+0000","last_became_peered":"2026-02-13T01:25:13.596699+0000","last_unstale":"2026-02-13T01:25:14.704994+0000","last_undegraded":"2026-02-13T01:25:14.704994+0000","last_fullsized":"2026-02-13T01:25:14.704994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:48.582092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595169+0000","last_change":"2026-02-13T01:25:13.596471+0000","last_active":"2026-02-13T01:25:14.595169+0000","last_peered":"2026-02-13T01:25:14.595169+0000","last_clean":"2026-02-13T01:25:14.595169+0000","last_became_active":"2026-02-13T01:25:13.596238+0000","last_became_peered":"2026-02-13T01:25:13.596238+0000","last_unstale":"2026-02-13T01:25:14.595169+0000","last_undegraded":"2026-02-13T01:25:14.595169+0000","last_fullsized":"2026-02-13T01:25:14.595169+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:05:24.893159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595418+0000","last_change":"2026-02-13T01:25:13.597034+0000","last_active":"2026-02-13T01:25:14.595418+0000","last_peered":"2026-02-13T01:25:14.595418+0000","last_clean":"2026-02-13T01:25:14.595418+0000","last_became_active":"2026-02-13T01:25:13.596573+0000","last_became_peered":"2026-02-13T01:25:13.596573+0000","last_unstale":"2026-02-13T01:25:14.595418+0000","last_undegraded":"2026-02-13T01:25:14.595418+0000","last_fullsized":"2026-02-13T01:25:14.595418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:49:51.020546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946112+0000","last_change":"2026-02-13T01:25:13.594615+0000","last_active":"2026-02-13T01:25:14.946112+0000","last_peered":"2026-02-13T01:25:14.946112+0000","last_clean":"2026-02-13T01:25:14.946112+0000","last_became_active":"2026-02-13T01:25:13.594349+0000","last_became_peered":"2026-02-13T01:25:13.594349+0000","last_unstale":"2026-02-13T01:25:14.946112+0000","last_undegraded":"2026-02-13T01:25:14.946112+0000","last_fullsized":"2026-02-13T01:25:14.946112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:03.697709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595137+0000","last_change":"2026-02-13T01:25:13.595949+0000","last_active":"2026-02-13T01:25:14.595137+0000","last_peered":"2026-02-13T01:25:14.595137+0000","last_clean":"2026-02-13T01:25:14.595137+0000","last_became_active":"2026-02-13T01:25:13.595183+0000","last_became_peered":"2026-02-13T01:25:13.595183+0000","last_unstale":"2026-02-13T01:25:14.595137+0000","last_undegraded":"2026-02-13T01:25:14.595137+0000","last_fullsized":"2026-02-13T01:25:14.595137+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:36.191774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:20.603256+0000","last_change":"2026-02-13T01:25:12.586512+0000","last_active":"2026-02-13T01:25:20.603256+0000","last_peered":"2026-02-13T01:25:20.603256+0000","last_clean":"2026-02-13T01:25:20.603256+0000","last_became_active":"2026-02-13T01:25:12.586332+0000","last_became_peered":"2026-02-13T01:25:12.586332+0000","last_unstale":"2026-02-13T01:25:20.603256+0000","last_undegraded":"2026-02-13T01:25:20.603256+0000","last_fullsized":"2026-02-13T01:25:20.603256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:04.971228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946750+0000","last_change":"2026-02-13T01:25:13.596348+0000","last_active":"2026-02-13T01:25:14.946750+0000","last_peered":"2026-02-13T01:25:14.946750+0000","last_clean":"2026-02-13T01:25:14.946750+0000","last_became_active":"2026-02-13T01:25:13.596143+0000","last_became_peered":"2026-02-13T01:25:13.596143+0000","last_unstale":"2026-02-13T01:25:14.946750+0000","last_undegraded":"2026-02-13T01:25:14.946750+0000","last_fullsized":"2026-02-13T01:25:14.946750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:49:34.818946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.614769+0000","last_change":"2026-02-13T01:25:12.583872+0000","last_active":"2026-02-13T01:25:17.614769+0000","last_peered":"2026-02-13T01:25:17.614769+0000","last_clean":"2026-02-13T01:25:17.614769+0000","last_became_active":"2026-02-13T01:25:12.583688+0000","last_became_peered":"2026-02-13T01:25:12.583688+0000","last_unstale":"2026-02-13T01:25:17.614769+0000","last_undegraded":"2026-02-13T01:25:17.614769+0000","last_fullsized":"2026-02-13T01:25:17.614769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:24:57.991039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.616292+0000","last_change":"2026-02-13T01:25:12.585552+0000","last_active":"2026-02-13T01:25:17.616292+0000","last_peered":"2026-02-13T01:25:17.616292+0000","last_clean":"2026-02-13T01:25:17.616292+0000","last_became_active":"2026-02-13T01:25:12.585237+0000","last_became_peered":"2026-02-13T01:25:12.585237+0000","last_unstale":"2026-02-13T01:25:17.616292+0000","last_undegraded":"2026-02-13T01:25:17.616292+0000","last_fullsized":"2026-02-13T01:25:17.616292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:48.661981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.623757+0000","last_change":"2026-02-13T01:25:13.597739+0000","last_active":"2026-02-13T01:25:21.623757+0000","last_peered":"2026-02-13T01:25:21.623757+0000","last_clean":"2026-02-13T01:25:21.623757+0000","last_became_active":"2026-02-13T01:25:13.597579+0000","last_became_peered":"2026-02-13T01:25:13.597579+0000","last_unstale":"2026-02-13T01:25:21.623757+0000","last_undegraded":"2026-02-13T01:25:21.623757+0000","last_fullsized":"2026-02-13T01:25:21.623757+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:34:45.020931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.609998+0000","last_change":"2026-02-13T01:25:12.586197+0000","last_active":"2026-02-13T01:25:19.609998+0000","last_peered":"2026-02-13T01:25:19.609998+0000","last_clean":"2026-02-13T01:25:19.609998+0000","last_became_active":"2026-02-13T01:25:12.585596+0000","last_became_peered":"2026-02-13T01:25:12.585596+0000","last_unstale":"2026-02-13T01:25:19.609998+0000","last_undegraded":"2026-02-13T01:25:19.609998+0000","last_fullsized":"2026-02-13T01:25:19.609998+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:43:32.118426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596800+0000","last_change":"2026-02-13T01:25:13.597729+0000","last_active":"2026-02-13T01:25:14.596800+0000","last_peered":"2026-02-13T01:25:14.596800+0000","last_clean":"2026-02-13T01:25:14.596800+0000","last_became_active":"2026-02-13T01:25:13.597613+0000","last_became_peered":"2026-02-13T01:25:13.597613+0000","last_unstale":"2026-02-13T01:25:14.596800+0000","last_undegraded":"2026-02-13T01:25:14.596800+0000","last_fullsized":"2026-02-13T01:25:14.596800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:55:31.684388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612834+0000","last_change":"2026-02-13T01:25:12.586878+0000","last_active":"2026-02-13T01:25:16.612834+0000","last_peered":"2026-02-13T01:25:16.612834+0000","last_clean":"2026-02-13T01:25:16.612834+0000","last_became_active":"2026-02-13T01:25:12.586734+0000","last_became_peered":"2026-02-13T01:25:12.586734+0000","last_unstale":"2026-02-13T01:25:16.612834+0000","last_undegraded":"2026-02-13T01:25:16.612834+0000","last_fullsized":"2026-02-13T01:25:16.612834+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:29:16.007641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947391+0000","last_change":"2026-02-13T01:25:13.599851+0000","last_active":"2026-02-13T01:25:14.947391+0000","last_peered":"2026-02-13T01:25:14.947391+0000","last_clean":"2026-02-13T01:25:14.947391+0000","last_became_active":"2026-02-13T01:25:13.599378+0000","last_became_peered":"2026-02-13T01:25:13.599378+0000","last_unstale":"2026-02-13T01:25:14.947391+0000","last_undegraded":"2026-02-13T01:25:14.947391+0000","last_fullsized":"2026-02-13T01:25:14.947391+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:17.930220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.610800+0000","last_change":"2026-02-13T01:25:12.586174+0000","last_active":"2026-02-13T01:25:19.610800+0000","last_peered":"2026-02-13T01:25:19.610800+0000","last_clean":"2026-02-13T01:25:19.610800+0000","last_became_active":"2026-02-13T01:25:12.585898+0000","last_became_peered":"2026-02-13T01:25:12.585898+0000","last_unstale":"2026-02-13T01:25:19.610800+0000","last_undegraded":"2026-02-13T01:25:19.610800+0000","last_fullsized":"2026-02-13T01:25:19.610800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:50:48.499836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.705016+0000","last_change":"2026-02-13T01:25:13.599679+0000","last_active":"2026-02-13T01:25:14.705016+0000","last_peered":"2026-02-13T01:25:14.705016+0000","last_clean":"2026-02-13T01:25:14.705016+0000","last_became_active":"2026-02-13T01:25:13.599505+0000","last_became_peered":"2026-02-13T01:25:13.599505+0000","last_unstale":"2026-02-13T01:25:14.705016+0000","last_undegraded":"2026-02-13T01:25:14.705016+0000","last_fullsized":"2026-02-13T01:25:14.705016+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:20:55.098705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.601443+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:18.601443+0000","last_peered":"2026-02-13T01:25:18.601443+0000","last_clean":"2026-02-13T01:25:18.601443+0000","last_became_active":"2026-02-13T01:25:12.584983+0000","last_became_peered":"2026-02-13T01:25:12.584983+0000","last_unstale":"2026-02-13T01:25:18.601443+0000","last_undegraded":"2026-02-13T01:25:18.601443+0000","last_fullsized":"2026-02-13T01:25:18.601443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:19:34.247623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947080+0000","last_change":"2026-02-13T01:25:13.600875+0000","last_active":"2026-02-13T01:25:14.947080+0000","last_peered":"2026-02-13T01:25:14.947080+0000","last_clean":"2026-02-13T01:25:14.947080+0000","last_became_active":"2026-02-13T01:25:13.600022+0000","last_became_peered":"2026-02-13T01:25:13.600022+0000","last_unstale":"2026-02-13T01:25:14.947080+0000","last_undegraded":"2026-02-13T01:25:14.947080+0000","last_fullsized":"2026-02-13T01:25:14.947080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:12.241807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612270+0000","last_change":"2026-02-13T01:25:12.585602+0000","last_active":"2026-02-13T01:25:16.612270+0000","last_peered":"2026-02-13T01:25:16.612270+0000","last_clean":"2026-02-13T01:25:16.612270+0000","last_became_active":"2026-02-13T01:25:12.585421+0000","last_became_peered":"2026-02-13T01:25:12.585421+0000","last_unstale":"2026-02-13T01:25:16.612270+0000","last_undegraded":"2026-02-13T01:25:16.612270+0000","last_fullsized":"2026-02-13T01:25:16.612270+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:42.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1634,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595693+0000","last_change":"2026-02-13T01:25:13.595983+0000","last_active":"2026-02-13T01:25:14.595693+0000","last_peered":"2026-02-13T01:25:14.595693+0000","last_clean":"2026-02-13T01:25:14.595693+0000","last_became_active":"2026-02-13T01:25:13.594518+0000","last_became_peered":"2026-02-13T01:25:13.594518+0000","last_unstale":"2026-02-13T01:25:14.595693+0000","last_undegraded":"2026-02-13T01:25:14.595693+0000","last_fullsized":"2026-02-13T01:25:14.595693+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:16.951050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.609905+0000","last_change":"2026-02-13T01:25:12.585520+0000","last_active":"2026-02-13T01:25:19.609905+0000","last_peered":"2026-02-13T01:25:19.609905+0000","last_clean":"2026-02-13T01:25:19.609905+0000","last_became_active":"2026-02-13T01:25:12.584720+0000","last_became_peered":"2026-02-13T01:25:12.584720+0000","last_unstale":"2026-02-13T01:25:19.609905+0000","last_undegraded":"2026-02-13T01:25:19.609905+0000","last_fullsized":"2026-02-13T01:25:19.609905+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:52.811064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947738+0000","last_change":"2026-02-13T01:25:13.597736+0000","last_active":"2026-02-13T01:25:14.947738+0000","last_peered":"2026-02-13T01:25:14.947738+0000","last_clean":"2026-02-13T01:25:14.947738+0000","last_became_active":"2026-02-13T01:25:13.597635+0000","last_became_peered":"2026-02-13T01:25:13.597635+0000","last_unstale":"2026-02-13T01:25:14.947738+0000","last_undegraded":"2026-02-13T01:25:14.947738+0000","last_fullsized":"2026-02-13T01:25:14.947738+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:09.718614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.609997+0000","last_change":"2026-02-13T01:25:12.585611+0000","last_active":"2026-02-13T01:25:19.609997+0000","last_peered":"2026-02-13T01:25:19.609997+0000","last_clean":"2026-02-13T01:25:19.609997+0000","last_became_active":"2026-02-13T01:25:12.585213+0000","last_became_peered":"2026-02-13T01:25:12.585213+0000","last_unstale":"2026-02-13T01:25:19.609997+0000","last_undegraded":"2026-02-13T01:25:19.609997+0000","last_fullsized":"2026-02-13T01:25:19.609997+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:58.518168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932699+0000","last_change":"2026-02-13T01:25:13.596481+0000","last_active":"2026-02-13T01:25:14.932699+0000","last_peered":"2026-02-13T01:25:14.932699+0000","last_clean":"2026-02-13T01:25:14.932699+0000","last_became_active":"2026-02-13T01:25:13.596188+0000","last_became_peered":"2026-02-13T01:25:13.596188+0000","last_unstale":"2026-02-13T01:25:14.932699+0000","last_undegraded":"2026-02-13T01:25:14.932699+0000","last_fullsized":"2026-02-13T01:25:14.932699+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:31.070201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'5","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.605912+0000","last_change":"2026-02-13T01:25:12.585557+0000","last_active":"2026-02-13T01:25:18.605912+0000","last_peered":"2026-02-13T01:25:18.605912+0000","last_clean":"2026-02-13T01:25:18.605912+0000","last_became_active":"2026-02-13T01:25:12.585406+0000","last_became_peered":"2026-02-13T01:25:12.585406+0000","last_unstale":"2026-02-13T01:25:18.605912+0000","last_undegraded":"2026-02-13T01:25:18.605912+0000","last_fullsized":"2026-02-13T01:25:18.605912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:27.444543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932354+0000","last_change":"2026-02-13T01:25:13.596633+0000","last_active":"2026-02-13T01:25:14.932354+0000","last_peered":"2026-02-13T01:25:14.932354+0000","last_clean":"2026-02-13T01:25:14.932354+0000","last_became_active":"2026-02-13T01:25:13.596408+0000","last_became_peered":"2026-02-13T01:25:13.596408+0000","last_unstale":"2026-02-13T01:25:14.932354+0000","last_undegraded":"2026-02-13T01:25:14.932354+0000","last_fullsized":"2026-02-13T01:25:14.932354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:04:43.368134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.615219+0000","last_change":"2026-02-13T01:25:12.585798+0000","last_active":"2026-02-13T01:25:17.615219+0000","last_peered":"2026-02-13T01:25:17.615219+0000","last_clean":"2026-02-13T01:25:17.615219+0000","last_became_active":"2026-02-13T01:25:12.585641+0000","last_became_peered":"2026-02-13T01:25:12.585641+0000","last_unstale":"2026-02-13T01:25:17.615219+0000","last_undegraded":"2026-02-13T01:25:17.615219+0000","last_fullsized":"2026-02-13T01:25:17.615219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:16:39.636368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946456+0000","last_change":"2026-02-13T01:25:13.598371+0000","last_active":"2026-02-13T01:25:14.946456+0000","last_peered":"2026-02-13T01:25:14.946456+0000","last_clean":"2026-02-13T01:25:14.946456+0000","last_became_active":"2026-02-13T01:25:13.598256+0000","last_became_peered":"2026-02-13T01:25:13.598256+0000","last_unstale":"2026-02-13T01:25:14.946456+0000","last_undegraded":"2026-02-13T01:25:14.946456+0000","last_fullsized":"2026-02-13T01:25:14.946456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:55:02.299033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595836+0000","last_change":"2026-02-13T01:25:12.585124+0000","last_active":"2026-02-13T01:25:14.595836+0000","last_peered":"2026-02-13T01:25:14.595836+0000","last_clean":"2026-02-13T01:25:14.595836+0000","last_became_active":"2026-02-13T01:25:12.584899+0000","last_became_peered":"2026-02-13T01:25:12.584899+0000","last_unstale":"2026-02-13T01:25:14.595836+0000","last_undegraded":"2026-02-13T01:25:14.595836+0000","last_fullsized":"2026-02-13T01:25:14.595836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:20.160445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946480+0000","last_change":"2026-02-13T01:25:13.594139+0000","last_active":"2026-02-13T01:25:14.946480+0000","last_peered":"2026-02-13T01:25:14.946480+0000","last_clean":"2026-02-13T01:25:14.946480+0000","last_became_active":"2026-02-13T01:25:13.593871+0000","last_became_peered":"2026-02-13T01:25:13.593871+0000","last_unstale":"2026-02-13T01:25:14.946480+0000","last_undegraded":"2026-02-13T01:25:14.946480+0000","last_fullsized":"2026-02-13T01:25:14.946480+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:27.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947888+0000","last_change":"2026-02-13T01:25:12.587190+0000","last_active":"2026-02-13T01:25:14.947888+0000","last_peered":"2026-02-13T01:25:14.947888+0000","last_clean":"2026-02-13T01:25:14.947888+0000","last_became_active":"2026-02-13T01:25:12.586934+0000","last_became_peered":"2026-02-13T01:25:12.586934+0000","last_unstale":"2026-02-13T01:25:14.947888+0000","last_undegraded":"2026-02-13T01:25:14.947888+0000","last_fullsized":"2026-02-13T01:25:14.947888+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:59.367266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932714+0000","last_change":"2026-02-13T01:25:13.597938+0000","last_active":"2026-02-13T01:25:14.932714+0000","last_peered":"2026-02-13T01:25:14.932714+0000","last_clean":"2026-02-13T01:25:14.932714+0000","last_became_active":"2026-02-13T01:25:13.597812+0000","last_became_peered":"2026-02-13T01:25:13.597812+0000","last_unstale":"2026-02-13T01:25:14.932714+0000","last_undegraded":"2026-02-13T01:25:14.932714+0000","last_fullsized":"2026-02-13T01:25:14.932714+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:13.982549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.604675+0000","last_change":"2026-02-13T01:25:12.585792+0000","last_active":"2026-02-13T01:25:18.604675+0000","last_peered":"2026-02-13T01:25:18.604675+0000","last_clean":"2026-02-13T01:25:18.604675+0000","last_became_active":"2026-02-13T01:25:12.584980+0000","last_became_peered":"2026-02-13T01:25:12.584980+0000","last_unstale":"2026-02-13T01:25:18.604675+0000","last_undegraded":"2026-02-13T01:25:18.604675+0000","last_fullsized":"2026-02-13T01:25:18.604675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:44.806719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:15.931736+0000","last_change":"2026-02-13T01:25:13.597068+0000","last_active":"2026-02-13T01:25:15.931736+0000","last_peered":"2026-02-13T01:25:15.931736+0000","last_clean":"2026-02-13T01:25:15.931736+0000","last_became_active":"2026-02-13T01:25:13.596764+0000","last_became_peered":"2026-02-13T01:25:13.596764+0000","last_unstale":"2026-02-13T01:25:15.931736+0000","last_undegraded":"2026-02-13T01:25:15.931736+0000","last_fullsized":"2026-02-13T01:25:15.931736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:04.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.605529+0000","last_change":"2026-02-13T01:25:12.587494+0000","last_active":"2026-02-13T01:25:18.605529+0000","last_peered":"2026-02-13T01:25:18.605529+0000","last_clean":"2026-02-13T01:25:18.605529+0000","last_became_active":"2026-02-13T01:25:12.587302+0000","last_became_peered":"2026-02-13T01:25:12.587302+0000","last_unstale":"2026-02-13T01:25:18.605529+0000","last_undegraded":"2026-02-13T01:25:18.605529+0000","last_fullsized":"2026-02-13T01:25:18.605529+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:35.215432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932713+0000","last_change":"2026-02-13T01:25:13.599446+0000","last_active":"2026-02-13T01:25:14.932713+0000","last_peered":"2026-02-13T01:25:14.932713+0000","last_clean":"2026-02-13T01:25:14.932713+0000","last_became_active":"2026-02-13T01:25:13.599198+0000","last_became_peered":"2026-02-13T01:25:13.599198+0000","last_unstale":"2026-02-13T01:25:14.932713+0000","last_undegraded":"2026-02-13T01:25:14.932713+0000","last_fullsized":"2026-02-13T01:25:14.932713+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:43.435619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932277+0000","last_change":"2026-02-13T01:24:51.184559+0000","last_active":"2026-02-13T01:25:14.932277+0000","last_peered":"2026-02-13T01:25:14.932277+0000","last_clean":"2026-02-13T01:25:14.932277+0000","last_became_active":"2026-02-13T01:24:51.184384+0000","last_became_peered":"2026-02-13T01:24:51.184384+0000","last_unstale":"2026-02-13T01:25:14.932277+0000","last_undegraded":"2026-02-13T01:25:14.932277+0000","last_fullsized":"2026-02-13T01:25:14.932277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_clean_scrub_stamp":"2026-02-13T01:23:51.893115+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:29.993013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.605778+0000","last_change":"2026-02-13T01:25:12.585065+0000","last_active":"2026-02-13T01:25:18.605778+0000","last_peered":"2026-02-13T01:25:18.605778+0000","last_clean":"2026-02-13T01:25:18.605778+0000","last_became_active":"2026-02-13T01:25:12.584714+0000","last_became_peered":"2026-02-13T01:25:12.584714+0000","last_unstale":"2026-02-13T01:25:18.605778+0000","last_undegraded":"2026-02-13T01:25:18.605778+0000","last_fullsized":"2026-02-13T01:25:18.605778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:38.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.623835+0000","last_change":"2026-02-13T01:25:13.600026+0000","last_active":"2026-02-13T01:25:21.623835+0000","last_peered":"2026-02-13T01:25:21.623835+0000","last_clean":"2026-02-13T01:25:21.623835+0000","last_became_active":"2026-02-13T01:25:13.599911+0000","last_became_peered":"2026-02-13T01:25:13.599911+0000","last_unstale":"2026-02-13T01:25:21.623835+0000","last_undegraded":"2026-02-13T01:25:21.623835+0000","last_fullsized":"2026-02-13T01:25:21.623835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:32.272988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.615815+0000","last_change":"2026-02-13T01:25:12.586863+0000","last_active":"2026-02-13T01:25:17.615815+0000","last_peered":"2026-02-13T01:25:17.615815+0000","last_clean":"2026-02-13T01:25:17.615815+0000","last_became_active":"2026-02-13T01:25:12.586695+0000","last_became_peered":"2026-02-13T01:25:12.586695+0000","last_unstale":"2026-02-13T01:25:17.615815+0000","last_undegraded":"2026-02-13T01:25:17.615815+0000","last_fullsized":"2026-02-13T01:25:17.615815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:32.822119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947679+0000","last_change":"2026-02-13T01:25:13.596332+0000","last_active":"2026-02-13T01:25:14.947679+0000","last_peered":"2026-02-13T01:25:14.947679+0000","last_clean":"2026-02-13T01:25:14.947679+0000","last_became_active":"2026-02-13T01:25:13.596177+0000","last_became_peered":"2026-02-13T01:25:13.596177+0000","last_unstale":"2026-02-13T01:25:14.947679+0000","last_undegraded":"2026-02-13T01:25:14.947679+0000","last_fullsized":"2026-02-13T01:25:14.947679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:12.653773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.616850+0000","last_change":"2026-02-13T01:25:12.584951+0000","last_active":"2026-02-13T01:25:17.616850+0000","last_peered":"2026-02-13T01:25:17.616850+0000","last_clean":"2026-02-13T01:25:17.616850+0000","last_became_active":"2026-02-13T01:25:12.584782+0000","last_became_peered":"2026-02-13T01:25:12.584782+0000","last_unstale":"2026-02-13T01:25:17.616850+0000","last_undegraded":"2026-02-13T01:25:17.616850+0000","last_fullsized":"2026-02-13T01:25:17.616850+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:50:10.145512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946570+0000","last_change":"2026-02-13T01:25:13.595945+0000","last_active":"2026-02-13T01:25:14.946570+0000","last_peered":"2026-02-13T01:25:14.946570+0000","last_clean":"2026-02-13T01:25:14.946570+0000","last_became_active":"2026-02-13T01:25:13.595710+0000","last_became_peered":"2026-02-13T01:25:13.595710+0000","last_unstale":"2026-02-13T01:25:14.946570+0000","last_undegraded":"2026-02-13T01:25:14.946570+0000","last_fullsized":"2026-02-13T01:25:14.946570+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:48:20.578618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:20.614244+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:20.614244+0000","last_peered":"2026-02-13T01:25:20.614244+0000","last_clean":"2026-02-13T01:25:20.614244+0000","last_became_active":"2026-02-13T01:25:12.584995+0000","last_became_peered":"2026-02-13T01:25:12.584995+0000","last_unstale":"2026-02-13T01:25:20.614244+0000","last_undegraded":"2026-02-13T01:25:20.614244+0000","last_fullsized":"2026-02-13T01:25:20.614244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:26.521420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596550+0000","last_change":"2026-02-13T01:25:13.599307+0000","last_active":"2026-02-13T01:25:14.596550+0000","last_peered":"2026-02-13T01:25:14.596550+0000","last_clean":"2026-02-13T01:25:14.596550+0000","last_became_active":"2026-02-13T01:25:13.599019+0000","last_became_peered":"2026-02-13T01:25:13.599019+0000","last_unstale":"2026-02-13T01:25:14.596550+0000","last_undegraded":"2026-02-13T01:25:14.596550+0000","last_fullsized":"2026-02-13T01:25:14.596550+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:39.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:15.626219+0000","last_change":"2026-02-13T01:25:12.588474+0000","last_active":"2026-02-13T01:25:15.626219+0000","last_peered":"2026-02-13T01:25:15.626219+0000","last_clean":"2026-02-13T01:25:15.626219+0000","last_became_active":"2026-02-13T01:25:12.588114+0000","last_became_peered":"2026-02-13T01:25:12.588114+0000","last_unstale":"2026-02-13T01:25:15.626219+0000","last_undegraded":"2026-02-13T01:25:15.626219+0000","last_fullsized":"2026-02-13T01:25:15.626219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:05:18.579891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.596601+0000","last_change":"2026-02-13T01:25:13.599386+0000","last_active":"2026-02-13T01:25:14.596601+0000","last_peered":"2026-02-13T01:25:14.596601+0000","last_clean":"2026-02-13T01:25:14.596601+0000","last_became_active":"2026-02-13T01:25:13.598797+0000","last_became_peered":"2026-02-13T01:25:13.598797+0000","last_unstale":"2026-02-13T01:25:14.596601+0000","last_undegraded":"2026-02-13T01:25:14.596601+0000","last_fullsized":"2026-02-13T01:25:14.596601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:47:41.920834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595862+0000","last_change":"2026-02-13T01:25:12.584149+0000","last_active":"2026-02-13T01:25:14.595862+0000","last_peered":"2026-02-13T01:25:14.595862+0000","last_clean":"2026-02-13T01:25:14.595862+0000","last_became_active":"2026-02-13T01:25:12.583192+0000","last_became_peered":"2026-02-13T01:25:12.583192+0000","last_unstale":"2026-02-13T01:25:14.595862+0000","last_undegraded":"2026-02-13T01:25:14.595862+0000","last_fullsized":"2026-02-13T01:25:14.595862+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:49.438788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.947865+0000","last_change":"2026-02-13T01:25:13.596354+0000","last_active":"2026-02-13T01:25:14.947865+0000","last_peered":"2026-02-13T01:25:14.947865+0000","last_clean":"2026-02-13T01:25:14.947865+0000","last_became_active":"2026-02-13T01:25:13.596192+0000","last_became_peered":"2026-02-13T01:25:13.596192+0000","last_unstale":"2026-02-13T01:25:14.947865+0000","last_undegraded":"2026-02-13T01:25:14.947865+0000","last_fullsized":"2026-02-13T01:25:14.947865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:39:38.836223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.607870+0000","last_change":"2026-02-13T01:25:12.588331+0000","last_active":"2026-02-13T01:25:18.607870+0000","last_peered":"2026-02-13T01:25:18.607870+0000","last_clean":"2026-02-13T01:25:18.607870+0000","last_became_active":"2026-02-13T01:25:12.588071+0000","last_became_peered":"2026-02-13T01:25:12.588071+0000","last_unstale":"2026-02-13T01:25:18.607870+0000","last_undegraded":"2026-02-13T01:25:18.607870+0000","last_fullsized":"2026-02-13T01:25:18.607870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:35.866770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.624123+0000","last_change":"2026-02-13T01:25:13.598530+0000","last_active":"2026-02-13T01:25:21.624123+0000","last_peered":"2026-02-13T01:25:21.624123+0000","last_clean":"2026-02-13T01:25:21.624123+0000","last_became_active":"2026-02-13T01:25:13.598219+0000","last_became_peered":"2026-02-13T01:25:13.598219+0000","last_unstale":"2026-02-13T01:25:21.624123+0000","last_undegraded":"2026-02-13T01:25:21.624123+0000","last_fullsized":"2026-02-13T01:25:21.624123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:28:20.723555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612700+0000","last_change":"2026-02-13T01:25:12.588841+0000","last_active":"2026-02-13T01:25:16.612700+0000","last_peered":"2026-02-13T01:25:16.612700+0000","last_clean":"2026-02-13T01:25:16.612700+0000","last_became_active":"2026-02-13T01:25:12.588740+0000","last_became_peered":"2026-02-13T01:25:12.588740+0000","last_unstale":"2026-02-13T01:25:16.612700+0000","last_undegraded":"2026-02-13T01:25:16.612700+0000","last_fullsized":"2026-02-13T01:25:16.612700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:24.749019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.704997+0000","last_change":"2026-02-13T01:25:13.599374+0000","last_active":"2026-02-13T01:25:14.704997+0000","last_peered":"2026-02-13T01:25:14.704997+0000","last_clean":"2026-02-13T01:25:14.704997+0000","last_became_active":"2026-02-13T01:25:13.599203+0000","last_became_peered":"2026-02-13T01:25:13.599203+0000","last_unstale":"2026-02-13T01:25:14.704997+0000","last_undegraded":"2026-02-13T01:25:14.704997+0000","last_fullsized":"2026-02-13T01:25:14.704997+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.788063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612542+0000","last_change":"2026-02-13T01:25:12.586929+0000","last_active":"2026-02-13T01:25:16.612542+0000","last_peered":"2026-02-13T01:25:16.612542+0000","last_clean":"2026-02-13T01:25:16.612542+0000","last_became_active":"2026-02-13T01:25:12.586784+0000","last_became_peered":"2026-02-13T01:25:12.586784+0000","last_unstale":"2026-02-13T01:25:16.612542+0000","last_undegraded":"2026-02-13T01:25:16.612542+0000","last_fullsized":"2026-02-13T01:25:16.612542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:42.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.594901+0000","last_change":"2026-02-13T01:25:13.595662+0000","last_active":"2026-02-13T01:25:14.594901+0000","last_peered":"2026-02-13T01:25:14.594901+0000","last_clean":"2026-02-13T01:25:14.594901+0000","last_became_active":"2026-02-13T01:25:13.595175+0000","last_became_peered":"2026-02-13T01:25:13.595175+0000","last_unstale":"2026-02-13T01:25:14.594901+0000","last_undegraded":"2026-02-13T01:25:14.594901+0000","last_fullsized":"2026-02-13T01:25:14.594901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:55.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.623823+0000","last_change":"2026-02-13T01:25:12.585367+0000","last_active":"2026-02-13T01:25:21.623823+0000","last_peered":"2026-02-13T01:25:21.623823+0000","last_clean":"2026-02-13T01:25:21.623823+0000","last_became_active":"2026-02-13T01:25:12.585130+0000","last_became_peered":"2026-02-13T01:25:12.585130+0000","last_unstale":"2026-02-13T01:25:21.623823+0000","last_undegraded":"2026-02-13T01:25:21.623823+0000","last_fullsized":"2026-02-13T01:25:21.623823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:40.260699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946361+0000","last_change":"2026-02-13T01:25:13.595087+0000","last_active":"2026-02-13T01:25:14.946361+0000","last_peered":"2026-02-13T01:25:14.946361+0000","last_clean":"2026-02-13T01:25:14.946361+0000","last_became_active":"2026-02-13T01:25:13.594916+0000","last_became_peered":"2026-02-13T01:25:13.594916+0000","last_unstale":"2026-02-13T01:25:14.946361+0000","last_undegraded":"2026-02-13T01:25:14.946361+0000","last_fullsized":"2026-02-13T01:25:14.946361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:22:33.449950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:18.604847+0000","last_change":"2026-02-13T01:25:12.586261+0000","last_active":"2026-02-13T01:25:18.604847+0000","last_peered":"2026-02-13T01:25:18.604847+0000","last_clean":"2026-02-13T01:25:18.604847+0000","last_became_active":"2026-02-13T01:25:12.585946+0000","last_became_peered":"2026-02-13T01:25:12.585946+0000","last_unstale":"2026-02-13T01:25:18.604847+0000","last_undegraded":"2026-02-13T01:25:18.604847+0000","last_fullsized":"2026-02-13T01:25:18.604847+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:13:33.342624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.623892+0000","last_change":"2026-02-13T01:25:13.597108+0000","last_active":"2026-02-13T01:25:21.623892+0000","last_peered":"2026-02-13T01:25:21.623892+0000","last_clean":"2026-02-13T01:25:21.623892+0000","last_became_active":"2026-02-13T01:25:13.596931+0000","last_became_peered":"2026-02-13T01:25:13.596931+0000","last_unstale":"2026-02-13T01:25:21.623892+0000","last_undegraded":"2026-02-13T01:25:21.623892+0000","last_fullsized":"2026-02-13T01:25:21.623892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:17:57.428194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:16.612288+0000","last_change":"2026-02-13T01:25:12.585506+0000","last_active":"2026-02-13T01:25:16.612288+0000","last_peered":"2026-02-13T01:25:16.612288+0000","last_clean":"2026-02-13T01:25:16.612288+0000","last_became_active":"2026-02-13T01:25:12.585015+0000","last_became_peered":"2026-02-13T01:25:12.585015+0000","last_unstale":"2026-02-13T01:25:16.612288+0000","last_undegraded":"2026-02-13T01:25:16.612288+0000","last_fullsized":"2026-02-13T01:25:16.612288+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:35:07.130309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.932671+0000","last_change":"2026-02-13T01:25:13.599415+0000","last_active":"2026-02-13T01:25:14.932671+0000","last_peered":"2026-02-13T01:25:14.932671+0000","last_clean":"2026-02-13T01:25:14.932671+0000","last_became_active":"2026-02-13T01:25:13.599143+0000","last_became_peered":"2026-02-13T01:25:13.599143+0000","last_unstale":"2026-02-13T01:25:14.932671+0000","last_undegraded":"2026-02-13T01:25:14.932671+0000","last_fullsized":"2026-02-13T01:25:14.932671+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:31.271789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946890+0000","last_change":"2026-02-13T01:25:13.600494+0000","last_active":"2026-02-13T01:25:14.946890+0000","last_peered":"2026-02-13T01:25:14.946890+0000","last_clean":"2026-02-13T01:25:14.946890+0000","last_became_active":"2026-02-13T01:25:13.600302+0000","last_became_peered":"2026-02-13T01:25:13.600302+0000","last_unstale":"2026-02-13T01:25:14.946890+0000","last_undegraded":"2026-02-13T01:25:14.946890+0000","last_fullsized":"2026-02-13T01:25:14.946890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:50:25.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.595462+0000","last_change":"2026-02-13T01:25:12.584795+0000","last_active":"2026-02-13T01:25:14.595462+0000","last_peered":"2026-02-13T01:25:14.595462+0000","last_clean":"2026-02-13T01:25:14.595462+0000","last_became_active":"2026-02-13T01:25:12.584392+0000","last_became_peered":"2026-02-13T01:25:12.584392+0000","last_unstale":"2026-02-13T01:25:14.595462+0000","last_undegraded":"2026-02-13T01:25:14.595462+0000","last_fullsized":"2026-02-13T01:25:14.595462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:47.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.946947+0000","last_change":"2026-02-13T01:25:13.600631+0000","last_active":"2026-02-13T01:25:14.946947+0000","last_peered":"2026-02-13T01:25:14.946947+0000","last_clean":"2026-02-13T01:25:14.946947+0000","last_became_active":"2026-02-13T01:25:13.599642+0000","last_became_peered":"2026-02-13T01:25:13.599642+0000","last_unstale":"2026-02-13T01:25:14.946947+0000","last_undegraded":"2026-02-13T01:25:14.946947+0000","last_fullsized":"2026-02-13T01:25:14.946947+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:03:02.974206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:17.614579+0000","last_change":"2026-02-13T01:25:12.584754+0000","last_active":"2026-02-13T01:25:17.614579+0000","last_peered":"2026-02-13T01:25:17.614579+0000","last_clean":"2026-02-13T01:25:17.614579+0000","last_became_active":"2026-02-13T01:25:12.584425+0000","last_became_peered":"2026-02-13T01:25:12.584425+0000","last_unstale":"2026-02-13T01:25:17.614579+0000","last_undegraded":"2026-02-13T01:25:17.614579+0000","last_fullsized":"2026-02-13T01:25:17.614579+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:32:08.183856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:14.705004+0000","last_change":"2026-02-13T01:25:13.602615+0000","last_active":"2026-02-13T01:25:14.705004+0000","last_peered":"2026-02-13T01:25:14.705004+0000","last_clean":"2026-02-13T01:25:14.705004+0000","last_became_active":"2026-02-13T01:25:13.602511+0000","last_became_peered":"2026-02-13T01:25:13.602511+0000","last_unstale":"2026-02-13T01:25:14.705004+0000","last_undegraded":"2026-02-13T01:25:14.705004+0000","last_fullsized":"2026-02-13T01:25:14.705004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:27:59.716321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.624175+0000","last_change":"2026-02-13T01:25:12.588038+0000","last_active":"2026-02-13T01:25:21.624175+0000","last_peered":"2026-02-13T01:25:21.624175+0000","last_clean":"2026-02-13T01:25:21.624175+0000","last_became_active":"2026-02-13T01:25:12.587814+0000","last_became_peered":"2026-02-13T01:25:12.587814+0000","last_unstale":"2026-02-13T01:25:21.624175+0000","last_undegraded":"2026-02-13T01:25:21.624175+0000","last_fullsized":"2026-02-13T01:25:21.624175+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:56.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T01:25:21.624039+0000","last_change":"2026-02-13T01:25:13.598388+0000","last_active":"2026-02-13T01:25:21.624039+0000","last_peered":"2026-02-13T01:25:21.624039+0000","last_clean":"2026-02-13T01:25:21.624039+0000","last_became_active":"2026-02-13T01:25:13.598128+0000","last_became_peered":"2026-02-13T01:25:13.598128+0000","last_unstale":"2026-02-13T01:25:21.624039+0000","last_undegraded":"2026-02-13T01:25:21.624039+0000","last_fullsized":"2026-02-13T01:25:21.624039+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:42.080004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-13T01:25:19.612257+0000","last_change":"2026-02-13T01:25:12.587715+0000","last_active":"2026-02-13T01:25:19.612257+0000","last_peered":"2026-02-13T01:25:19.612257+0000","last_clean":"2026-02-13T01:25:19.612257+0000","last_became_active":"2026-02-13T01:25:12.587565+0000","last_became_peered":"2026-02-13T01:25:12.587565+0000","last_unstale":"2026-02-13T01:25:19.612257+0000","last_undegraded":"2026-02-13T01:25:19.612257+0000","last_fullsized":"2026-02-13T01:25:19.612257+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:23:52.902150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8146,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":25,"num_read_kb":20,"num_write":169,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":30737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":151913,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":300107,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710727,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":394792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939655,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":986770,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":22358,"internal_metadata":27568298},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":29,"kb_used_meta":26914,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":394312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30563,"internal_metadata":27560093},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299402,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":393928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26841,"internal_metadata":27563815},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528333,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27836,"kb_used_data":872,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975364,"statfs":{"total":751619276800,"available":751590772736,"internally_reserved":0,"allocated":892928,"data_stored":987542,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33569,"internal_metadata":27557087},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":393258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27074,"internal_metadata":27563582},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888080,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":37,"kb_used_meta":26906,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":986832,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":38434,"internal_metadata":27552222},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018897,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":393834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40128,"internal_metadata":27550528},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247827,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27804,"kb_used_data":840,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975396,"statfs":{"total":751619276800,"available":751590805504,"internally_reserved":0,"allocated":860160,"data_stored":402531,"data_compressed":2890,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":49418,"internal_metadata":27541238},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":57,"kb_used_meta":26886,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":396796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59309,"internal_metadata":27531347},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607572,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":394802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":53,"kb_used_meta":26890,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":395800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55060,"internal_metadata":27535596},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11428,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1713,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":11199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20675,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20726,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19596,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8288,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8008,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10315,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8714,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23205,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14688,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4557,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:22.822 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T01:25:22.823 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T01:25:22.823 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2026-02-13T01:25:22.840 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T01:25:22.841 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:25:22.841 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4190272638' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:22.841 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:22 trial091 ceph-mon[25068]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:22.957 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:22.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2026-02-13T01:25:22.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2026-02-13T01:25:22.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4190272638' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:22.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:22 trial154 ceph-mon[27045]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:23.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 -- 10.20.193.91:0/2015382357 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f810fbf0 msgr2=0x7f77f8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/2015382357 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f810fbf0 0x7f77f8114c30 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=11416842799521368399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77e00099a0 tx=0x7f77e002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 -- 10.20.193.91:0/2015382357 shutdown_connections 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/2015382357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f8115410 0x7f77f8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/2015382357 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f810fbf0 0x7f77f8114c30 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=11416842799521368399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/2015382357 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77f810f200 0x7f77f810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 -- 10.20.193.91:0/2015382357 >> 10.20.193.91:0/2015382357 conn(0x7f77f80ecb00 msgr2=0x7f77f810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 -- 10.20.193.91:0/2015382357 shutdown_connections 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 -- 10.20.193.91:0/2015382357 wait complete. 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 Processor -- start 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.076+0000 7f77fcf296c0 1 -- start start 2026-02-13T01:25:23.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77f810f200 0x7f77f80f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 0x7f77f8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f80f5320 0x7f77f80fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f77f80f5980 con 0x7f77f8115410 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f77f80faae0 con 0x7f77f80f5320 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77f80faca0 con 0x7f77f810f200 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 0x7f77f8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 0x7f77f8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36674/0 (socket says 10.20.193.91:36674) 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 -- 10.20.193.91:0/1923097251 learned_addr learned my addr 10.20.193.91:0/1923097251 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f6d766c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f80f5320 0x7f77f80fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f65756c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77f810f200 0x7f77f80f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 -- 10.20.193.91:0/1923097251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77f810f200 msgr2=0x7f77f80f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77f810f200 0x7f77f80f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 -- 10.20.193.91:0/1923097251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f80f5320 msgr2=0x7f77f80fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f80f5320 0x7f77f80fa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 -- 10.20.193.91:0/1923097251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e0009590 con 0x7f77f8115410 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f6d766c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f80f5320 0x7f77f80fa5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77f5d746c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 0x7f77f8175cb0 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77e00023a0 tx=0x7f77e002fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77e0002ae0 con 0x7f77f8115410 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f77e0002c40 con 0x7f77f8115410 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f80faec0 con 0x7f77f8115410 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77e00372f0 con 0x7f77f8115410 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.077+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f80fb340 con 0x7f77f8115410 2026-02-13T01:25:23.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.078+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f81104d0 con 0x7f77f8115410 2026-02-13T01:25:23.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.079+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f77e00071c0 con 0x7f77f8115410 2026-02-13T01:25:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.079+0000 7f77df7fe6c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77d00b56e0 0x7f77d00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.080+0000 7f77f65756c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77d00b56e0 0x7f77d00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.080+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f77e0108060 con 0x7f77f8115410 2026-02-13T01:25:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.080+0000 7f77f65756c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77d00b56e0 0x7f77d00d5b90 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77ec005980 tx=0x7f77ec005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.080+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77e00caa10 con 0x7f77f8115410 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 8]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3b", "id": [3, 9]}]': finished 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4190272638' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:23.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:22 trial126 ceph-mon[26569]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:23.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.208+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f77f810f5d0 con 0x7f77f8115410 2026-02-13T01:25:23.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.210+0000 7f77df7fe6c0 1 -- 10.20.193.91:0/1923097251 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f77e00cdbc0 con 0x7f77f8115410 2026-02-13T01:25:23.209 INFO:teuthology.orchestra.run.trial091.stdout:[client.0] 2026-02-13T01:25:23.209 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCDfY5piR17DBAA6FWmSBOTq69IWlz7x3VBVA== 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77d00b56e0 msgr2=0x7f77d00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77d00b56e0 0x7f77d00d5b90 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77ec005980 tx=0x7f77ec005910 comp rx=0 tx=0).stop 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 msgr2=0x7f77f8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 0x7f77f8175cb0 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77e00023a0 tx=0x7f77e002fbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 shutdown_connections 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77d00b56e0 0x7f77d00d5b90 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77f80f5320 0x7f77f80fa5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77f8115410 0x7f77f8175cb0 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 --2- 10.20.193.91:0/1923097251 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77f810f200 0x7f77f80f4cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 >> 10.20.193.91:0/1923097251 conn(0x7f77f80ecb00 msgr2=0x7f77f8111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 shutdown_connections 2026-02-13T01:25:23.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.211+0000 7f77fcf296c0 1 -- 10.20.193.91:0/1923097251 wait complete. 2026-02-13T01:25:23.250 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-13T01:25:23.250 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T01:25:23.250 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T01:25:23.286 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T01:25:23.442 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:23.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- 10.20.193.91:0/2270257405 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c10be60 msgr2=0x7fbd4c10c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/2270257405 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c10be60 0x7fbd4c10c230 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=17938961823380645848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c0099a0 tx=0x7fbd3c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:23.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- 10.20.193.91:0/2270257405 shutdown_connections 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/2270257405 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd4c112070 0x7fbd4c172a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/2270257405 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd4c10c850 0x7fbd4c111890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/2270257405 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c10be60 0x7fbd4c10c230 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=17938961823380645848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- 10.20.193.91:0/2270257405 >> 10.20.193.91:0/2270257405 conn(0x7fbd4c0e9740 msgr2=0x7fbd4c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- 10.20.193.91:0/2270257405 shutdown_connections 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- 10.20.193.91:0/2270257405 wait complete. 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 Processor -- start 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- start start 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd4c10be60 0x7fbd4c0f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 0x7fbd4c172910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd4c0f5260 0x7fbd4c0fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c0f5950 con 0x7fbd4c112070 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c0faa70 con 0x7fbd4c0f5260 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd52e516c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c0fac30 con 0x7fbd4c10be60 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd43fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 0x7fbd4c172910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd43fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 0x7fbd4c172910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36692/0 (socket says 10.20.193.91:36692) 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.556+0000 7fbd43fff6c0 1 -- 10.20.193.91:0/3514582921 learned_addr learned my addr 10.20.193.91:0/3514582921 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd50bc26c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd4c10be60 0x7fbd4c0f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd513c36c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd4c0f5260 0x7fbd4c0fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd43fff6c0 1 -- 10.20.193.91:0/3514582921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd4c10be60 msgr2=0x7fbd4c0f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd43fff6c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd4c10be60 0x7fbd4c0f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd43fff6c0 1 -- 10.20.193.91:0/3514582921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd4c0f5260 msgr2=0x7fbd4c0fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd43fff6c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd4c0f5260 0x7fbd4c0fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd43fff6c0 1 -- 10.20.193.91:0/3514582921 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c009590 con 0x7fbd4c112070 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd43fff6c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 0x7fbd4c172910 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3400b6c0 tx=0x7fbd3400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd34004250 con 0x7fbd4c112070 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c0faf10 con 0x7fbd4c112070 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbd34009070 con 0x7fbd4c112070 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbd3400ccb0 con 0x7fbd4c112070 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c0fb3a0 con 0x7fbd4c112070 2026-02-13T01:25:23.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.557+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd4c10d130 con 0x7fbd4c112070 2026-02-13T01:25:23.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.559+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fbd340028c0 con 0x7fbd4c112070 2026-02-13T01:25:23.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.559+0000 7fbd41ffb6c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbd280b56e0 0x7fbd280d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.559+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fbd340e3c10 con 0x7fbd4c112070 2026-02-13T01:25:23.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.559+0000 7fbd50bc26c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbd280b56e0 0x7fbd280d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.560+0000 7fbd50bc26c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbd280b56e0 0x7fbd280d5b90 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c0092e0 tx=0x7fbd3c005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.560+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbd340a6450 con 0x7fbd4c112070 2026-02-13T01:25:23.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.651+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fbd4c0fb3a0 con 0x7fbd4c112070 2026-02-13T01:25:23.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.651+0000 7fbd41ffb6c0 1 -- 10.20.193.91:0/3514582921 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7fbd4c0fb3a0 con 0x7fbd4c112070 2026-02-13T01:25:23.651 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:23.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.652+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbd280b56e0 msgr2=0x7fbd280d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.652+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbd280b56e0 0x7fbd280d5b90 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c0092e0 tx=0x7fbd3c005c00 comp rx=0 tx=0).stop 2026-02-13T01:25:23.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.652+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 msgr2=0x7fbd4c172910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.652+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 0x7fbd4c172910 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3400b6c0 tx=0x7fbd3400bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:23.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 shutdown_connections 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbd280b56e0 0x7fbd280d5b90 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd4c0f5260 0x7fbd4c0fa530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbd4c112070 0x7fbd4c172910 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 --2- 10.20.193.91:0/3514582921 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbd4c10be60 0x7fbd4c0f4c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 >> 10.20.193.91:0/3514582921 conn(0x7fbd4c0e9740 msgr2=0x7fbd4c10a300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 shutdown_connections 2026-02-13T01:25:23.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.653+0000 7fbd52e516c0 1 -- 10.20.193.91:0/3514582921 wait complete. 2026-02-13T01:25:23.693 INFO:teuthology.orchestra.run.trial091.stdout:[{"version":50,"timestamp":"2026-02-13T01:25:07.713827+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T01:25:23.693 INFO:tasks.ceph_manager:config epoch is 50 2026-02-13T01:25:23.693 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T01:25:23.695 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T01:25:23.695 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T01:25:23.718 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:23 trial091 ceph-mon[25068]: pgmap v182: 97 pgs: 97 active+clean; 585 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2026-02-13T01:25:23.718 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:23 trial091 ceph-mon[25068]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T01:25:23.718 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:23 trial091 ceph-mon[25068]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:23.718 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1923097251' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:23.718 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1923097251' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:25:23.812 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-mon[26569]: pgmap v182: 97 pgs: 97 active+clean; 585 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2026-02-13T01:25:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-mon[26569]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T01:25:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-mon[26569]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1923097251' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1923097251' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:25:23.849 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: 2026-02-13T01:25:23.576+0000 7f167629d6c0 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2026-02-13T01:25:23.849 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:25:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: 2026-02-13T01:25:23.576+0000 7f167629d6c0 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/2032680533 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc4410f230 msgr2=0x7fbc4410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/2032680533 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc4410f230 0x7fbc4410f600 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=4793611545084514749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc340099a0 tx=0x7fbc3402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/2032680533 shutdown_connections 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/2032680533 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44115440 0x7fbc44175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/2032680533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc4410fc20 0x7fbc44114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/2032680533 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc4410f230 0x7fbc4410f600 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=4793611545084514749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/2032680533 >> 10.20.193.91:0/2032680533 conn(0x7fbc440ecb30 msgr2=0x7fbc4410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:23.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/2032680533 shutdown_connections 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.924+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/2032680533 wait complete. 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 Processor -- start 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 -- start start 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc4410f230 0x7fbc4411d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 0x7fbc4411d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44122b30 0x7fbc44122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44123510 con 0x7fbc44115440 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44123680 con 0x7fbc4410f230 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44123840 con 0x7fbc44122b30 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 0x7fbc4411d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 0x7fbc4411d770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36702/0 (socket says 10.20.193.91:36702) 2026-02-13T01:25:23.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 -- 10.20.193.91:0/3700022065 learned_addr learned my addr 10.20.193.91:0/3700022065 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc491d86c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc4410f230 0x7fbc4411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc499d96c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44122b30 0x7fbc44122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 -- 10.20.193.91:0/3700022065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44122b30 msgr2=0x7fbc44122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44122b30 0x7fbc44122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 -- 10.20.193.91:0/3700022065 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc4410f230 msgr2=0x7fbc4411d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc4410f230 0x7fbc4411d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 -- 10.20.193.91:0/3700022065 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc34009590 con 0x7fbc44115440 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc499d96c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44122b30 0x7fbc44122fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc489d76c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 0x7fbc4411d770 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc38005dc0 tx=0x7fbc3800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc38004250 con 0x7fbc44115440 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbc38009070 con 0x7fbc44115440 2026-02-13T01:25:23.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.925+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc44163cc0 con 0x7fbc44115440 2026-02-13T01:25:23.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.926+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbc3800cd50 con 0x7fbc44115440 2026-02-13T01:25:23.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.926+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441641a0 con 0x7fbc44115440 2026-02-13T01:25:23.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.926+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc44110500 con 0x7fbc44115440 2026-02-13T01:25:23.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.928+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fbc380028c0 con 0x7fbc44115440 2026-02-13T01:25:23.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.928+0000 7fbc327fc6c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc200b56e0 0x7fbc200d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:23.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.928+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fbc380e3d20 con 0x7fbc44115440 2026-02-13T01:25:23.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.928+0000 7fbc491d86c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc200b56e0 0x7fbc200d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:23.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.928+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbc380e4210 con 0x7fbc44115440 2026-02-13T01:25:23.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:23.929+0000 7fbc491d86c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc200b56e0 0x7fbc200d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc340023e0 tx=0x7fbc34005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:23.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:23 trial154 ceph-mon[27045]: pgmap v182: 97 pgs: 97 active+clean; 585 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2026-02-13T01:25:23.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:23 trial154 ceph-mon[27045]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T01:25:23.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:23 trial154 ceph-mon[27045]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:23.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1923097251' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T01:25:23.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1923097251' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T01:25:24.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.048+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fbc4410fc20 con 0x7fbc44115440 2026-02-13T01:25:24.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.050+0000 7fbc327fc6c0 1 -- 10.20.193.91:0/3700022065 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) ==== 74+0+297594 (secure 0 0 0) 0x7fbc380a65a0 con 0x7fbc44115440 2026-02-13T01:25:24.054 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:24.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc200b56e0 msgr2=0x7fbc200d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc200b56e0 0x7fbc200d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc340023e0 tx=0x7fbc34005c60 comp rx=0 tx=0).stop 2026-02-13T01:25:24.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 msgr2=0x7fbc4411d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 0x7fbc4411d770 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc38005dc0 tx=0x7fbc3800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 shutdown_connections 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc200b56e0 0x7fbc200d5b90 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbc44122b30 0x7fbc44122fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbc44115440 0x7fbc4411d770 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 --2- 10.20.193.91:0/3700022065 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc4410f230 0x7fbc4411d230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 >> 10.20.193.91:0/3700022065 conn(0x7fbc440ecb30 msgr2=0x7fbc4410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 shutdown_connections 2026-02-13T01:25:24.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.052+0000 7fbc4b4676c0 1 -- 10.20.193.91:0/3700022065 wait complete. 2026-02-13T01:25:24.091 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":16,"flags":0,"active_gid":14190,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6800","nonce":3278861816},{"type":"v1","addr":"10.20.193.91:6801","nonce":3278861816}]},"active_addr":"10.20.193.91:6801/3278861816","active_change":"2026-02-13T01:23:21.300415+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24226,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24233,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":4,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":384809640}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":1740015184}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":3336912974}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":2633109285}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":1689730258}]}]} 2026-02-13T01:25:24.102 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T01:25:24.102 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T01:25:24.103 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:24.247 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:24.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- 10.20.193.91:0/1583325553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4630115410 msgr2=0x7f4630175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- 10.20.193.91:0/1583325553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4630115410 0x7f4630175db0 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=15708105994130787264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f462400aa70 tx=0x7f462402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- 10.20.193.91:0/1583325553 shutdown_connections 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- 10.20.193.91:0/1583325553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4630115410 0x7f4630175db0 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=15708105994130787264 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- 10.20.193.91:0/1583325553 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f463010fbf0 0x7f4630114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- 10.20.193.91:0/1583325553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f463010f200 0x7f463010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- 10.20.193.91:0/1583325553 >> 10.20.193.91:0/1583325553 conn(0x7f46300ecb00 msgr2=0x7f463010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- 10.20.193.91:0/1583325553 shutdown_connections 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- 10.20.193.91:0/1583325553 wait complete. 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 Processor -- start 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- start start 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 0x7f463011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4630115410 0x7f463011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4630122b50 0x7f4630122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4630123560 con 0x7f463010f200 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f46301236d0 con 0x7f4630122b50 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f46369546c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4630123890 con 0x7f4630115410 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f462ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 0x7f463011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f462ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 0x7f463011d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36724/0 (socket says 10.20.193.91:36724) 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.362+0000 7f462ffff6c0 1 -- 10.20.193.91:0/1843805496 learned_addr learned my addr 10.20.193.91:0/1843805496 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462f7fe6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4630115410 0x7f463011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f4634ec66c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4630122b50 0x7f4630122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462ffff6c0 1 -- 10.20.193.91:0/1843805496 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4630115410 msgr2=0x7f463011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462ffff6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4630115410 0x7f463011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462ffff6c0 1 -- 10.20.193.91:0/1843805496 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4630122b50 msgr2=0x7f4630122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462ffff6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4630122b50 0x7f4630122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462ffff6c0 1 -- 10.20.193.91:0/1843805496 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462400a660 con 0x7f463010f200 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462f7fe6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4630115410 0x7f463011d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f4634ec66c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4630122b50 0x7f4630122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462ffff6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 0x7f463011d250 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f461c00b710 tx=0x7f461c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f461c004250 con 0x7f463010f200 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f461c009070 con 0x7f463010f200 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f461c00ccd0 con 0x7f463010f200 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4630163d40 con 0x7f463010f200 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46301641d0 con 0x7f463010f200 2026-02-13T01:25:24.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.363+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46301104d0 con 0x7f463010f200 2026-02-13T01:25:24.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.365+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f461c0028c0 con 0x7f463010f200 2026-02-13T01:25:24.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.365+0000 7f462d7fa6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46040b5760 0x7f46040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.366+0000 7f462f7fe6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46040b5760 0x7f46040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.366+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f461c0e3eb0 con 0x7f463010f200 2026-02-13T01:25:24.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.366+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f461c0a98e0 con 0x7f463010f200 2026-02-13T01:25:24.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.366+0000 7f462f7fe6c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46040b5760 0x7f46040d5c10 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4630123be0 tx=0x7f4620005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:24.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.456+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f463010fbf0 con 0x7f463010f200 2026-02-13T01:25:24.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.457+0000 7f462d7fa6c0 1 -- 10.20.193.91:0/1843805496 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22799 (secure 0 0 0) 0x7f461c0a9ac0 con 0x7f463010f200 2026-02-13T01:25:24.457 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:24.457 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":77,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","created":"2026-02-13T01:22:42.667442+0000","modified":"2026-02-13T01:25:22.622748+0000","last_up_change":"2026-02-13T01:24:55.419630+0000","last_in_change":"2026-02-13T01:24:47.172971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:51.498651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:10.736175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:11.959007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1ffbd7ff-7a87-4947-8ce2-ad23813a7754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6803","nonce":170892896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6805","nonce":170892896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6809","nonce":170892896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6807","nonce":170892896}]},"public_addr":"10.20.193.91:6803/170892896","cluster_addr":"10.20.193.91:6805/170892896","heartbeat_back_addr":"10.20.193.91:6809/170892896","heartbeat_front_addr":"10.20.193.91:6807/170892896","state":["exists","up"]},{"osd":1,"uuid":"5d698ba3-8a17-455c-b05d-8ca1c9d44466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6801","nonce":1754332231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6803","nonce":1754332231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6807","nonce":1754332231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6805","nonce":1754332231}]},"public_addr":"10.20.193.126:6801/1754332231","cluster_addr":"10.20.193.126:6803/1754332231","heartbeat_back_addr":"10.20.193.126:6807/1754332231","heartbeat_front_addr":"10.20.193.126:6805/1754332231","state":["exists","up"]},{"osd":2,"uuid":"4b9d9a44-7956-4117-ada8-cb99016ae048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6801","nonce":1701976259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6803","nonce":1701976259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6807","nonce":1701976259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6805","nonce":1701976259}]},"public_addr":"10.20.193.154:6801/1701976259","cluster_addr":"10.20.193.154:6803/1701976259","heartbeat_back_addr":"10.20.193.154:6807/1701976259","heartbeat_front_addr":"10.20.193.154:6805/1701976259","state":["exists","up"]},{"osd":3,"uuid":"bb667b65-2ce1-4131-88de-53efa7c8fb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6811","nonce":746110270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6813","nonce":746110270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6817","nonce":746110270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6815","nonce":746110270}]},"public_addr":"10.20.193.91:6811/746110270","cluster_addr":"10.20.193.91:6813/746110270","heartbeat_back_addr":"10.20.193.91:6817/746110270","heartbeat_front_addr":"10.20.193.91:6815/746110270","state":["exists","up"]},{"osd":4,"uuid":"a2569ae9-0cac-4935-94f5-bfcbd0376cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6809","nonce":2328526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6811","nonce":2328526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6815","nonce":2328526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6813","nonce":2328526761}]},"public_addr":"10.20.193.126:6809/2328526761","cluster_addr":"10.20.193.126:6811/2328526761","heartbeat_back_addr":"10.20.193.126:6815/2328526761","heartbeat_front_addr":"10.20.193.126:6813/2328526761","state":["exists","up"]},{"osd":5,"uuid":"6279cc06-cf48-430f-929b-fde87b33e114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6809","nonce":2892893681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6811","nonce":2892893681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6815","nonce":2892893681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6813","nonce":2892893681}]},"public_addr":"10.20.193.154:6809/2892893681","cluster_addr":"10.20.193.154:6811/2892893681","heartbeat_back_addr":"10.20.193.154:6815/2892893681","heartbeat_front_addr":"10.20.193.154:6813/2892893681","state":["exists","up"]},{"osd":6,"uuid":"47579bf9-6170-4408-810f-8be850659d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6819","nonce":1887880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6821","nonce":1887880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6825","nonce":1887880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6823","nonce":1887880552}]},"public_addr":"10.20.193.91:6819/1887880552","cluster_addr":"10.20.193.91:6821/1887880552","heartbeat_back_addr":"10.20.193.91:6825/1887880552","heartbeat_front_addr":"10.20.193.91:6823/1887880552","state":["exists","up"]},{"osd":7,"uuid":"5ec7f6c4-8479-4e14-855e-fa3b594f058c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6817","nonce":1270299623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6819","nonce":1270299623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6823","nonce":1270299623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6821","nonce":1270299623}]},"public_addr":"10.20.193.126:6817/1270299623","cluster_addr":"10.20.193.126:6819/1270299623","heartbeat_back_addr":"10.20.193.126:6823/1270299623","heartbeat_front_addr":"10.20.193.126:6821/1270299623","state":["exists","up"]},{"osd":8,"uuid":"19fbc479-f0bf-46d3-9d48-648388632fb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6817","nonce":1364755569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6819","nonce":1364755569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6823","nonce":1364755569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6821","nonce":1364755569}]},"public_addr":"10.20.193.154:6817/1364755569","cluster_addr":"10.20.193.154:6819/1364755569","heartbeat_back_addr":"10.20.193.154:6823/1364755569","heartbeat_front_addr":"10.20.193.154:6821/1364755569","state":["exists","up"]},{"osd":9,"uuid":"a3befdc3-c847-4659-9ec1-0dd5e3172fe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6827","nonce":1541303371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6829","nonce":1541303371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6833","nonce":1541303371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6831","nonce":1541303371}]},"public_addr":"10.20.193.91:6827/1541303371","cluster_addr":"10.20.193.91:6829/1541303371","heartbeat_back_addr":"10.20.193.91:6833/1541303371","heartbeat_front_addr":"10.20.193.91:6831/1541303371","state":["exists","up"]},{"osd":10,"uuid":"36fe781f-9334-474b-bc6b-01e798e72a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6825","nonce":3309349280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6827","nonce":3309349280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6831","nonce":3309349280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6829","nonce":3309349280}]},"public_addr":"10.20.193.126:6825/3309349280","cluster_addr":"10.20.193.126:6827/3309349280","heartbeat_back_addr":"10.20.193.126:6831/3309349280","heartbeat_front_addr":"10.20.193.126:6829/3309349280","state":["exists","up"]},{"osd":11,"uuid":"5f569e12-4d88-4cf0-8f2e-147ace91f917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6825","nonce":1394532940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6827","nonce":1394532940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6831","nonce":1394532940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6829","nonce":1394532940}]},"public_addr":"10.20.193.154:6825/1394532940","cluster_addr":"10.20.193.154:6827/1394532940","heartbeat_back_addr":"10.20.193.154:6831/1394532940","heartbeat_front_addr":"10.20.193.154:6829/1394532940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:34.061683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.894443+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:47.963906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.184288+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:02.378327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:09.561223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:16.947535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:24.187301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.493620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:38.824765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.268089+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:53.733044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.91:6801/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/624457179":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/335308306":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/2950715894":"2026-02-14T01:22:48.728580+0000","10.20.193.91:6801/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/3747672627":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/2063745168":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/1509443464":"2026-02-14T01:22:48.728580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:24.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46040b5760 msgr2=0x7f46040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46040b5760 0x7f46040d5c10 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4630123be0 tx=0x7f4620005f10 comp rx=0 tx=0).stop 2026-02-13T01:25:24.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 msgr2=0x7f463011d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 0x7f463011d250 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f461c00b710 tx=0x7f461c00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 shutdown_connections 2026-02-13T01:25:24.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46040b5760 0x7f46040d5c10 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4630122b50 0x7f4630122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4630115410 0x7f463011d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 --2- 10.20.193.91:0/1843805496 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f463010f200 0x7f463011d250 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 >> 10.20.193.91:0/1843805496 conn(0x7f46300ecb00 msgr2=0x7f463010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:24.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 shutdown_connections 2026-02-13T01:25:24.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.458+0000 7f46369546c0 1 -- 10.20.193.91:0/1843805496 wait complete. 2026-02-13T01:25:24.498 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T01:25:24.498 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T01:25:24.613 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2179439263 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10fbf0 msgr2=0x7f6e7c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2179439263 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10fbf0 0x7f6e7c114c30 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=11665794289241180539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6c0099a0 tx=0x7f6e6c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2179439263 shutdown_connections 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2179439263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e7c115410 0x7f6e7c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2179439263 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10fbf0 0x7f6e7c114c30 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=11665794289241180539 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2179439263 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c10f200 0x7f6e7c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2179439263 >> 10.20.193.91:0/2179439263 conn(0x7f6e7c0ecb00 msgr2=0x7f6e7c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2179439263 shutdown_connections 2026-02-13T01:25:24.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.733+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2179439263 wait complete. 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 Processor -- start 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 -- start start 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 0x7f6e7c0f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e7c115410 0x7f6e7c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c0f52c0 0x7f6e7c0fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c0f5920 con 0x7f6e7c10f200 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c0faad0 con 0x7f6e7c115410 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c0fac90 con 0x7f6e7c0f52c0 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 0x7f6e7c0f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 0x7f6e7c0f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36736/0 (socket says 10.20.193.91:36736) 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 -- 10.20.193.91:0/2029686119 learned_addr learned my addr 10.20.193.91:0/2029686119 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:24.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7affd6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e7c115410 0x7f6e7c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7bfff6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c0f52c0 0x7f6e7c0fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 -- 10.20.193.91:0/2029686119 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c0f52c0 msgr2=0x7f6e7c0fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c0f52c0 0x7f6e7c0fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 -- 10.20.193.91:0/2029686119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e7c115410 msgr2=0x7f6e7c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e7c115410 0x7f6e7c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 -- 10.20.193.91:0/2029686119 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e6c009590 con 0x7f6e7c10f200 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7bfff6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c0f52c0 0x7f6e7c0fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e7b7fe6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 0x7f6e7c0f4c90 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6800b710 tx=0x7f6e6800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e68004250 con 0x7f6e7c10f200 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6e68002d80 con 0x7f6e7c10f200 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c0faf10 con 0x7f6e7c10f200 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e6800cdc0 con 0x7f6e7c10f200 2026-02-13T01:25:24.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.734+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c0fb3f0 con 0x7f6e7c10f200 2026-02-13T01:25:24.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.735+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e7c1104d0 con 0x7f6e7c10f200 2026-02-13T01:25:24.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.736+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6e680028c0 con 0x7f6e7c10f200 2026-02-13T01:25:24.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.737+0000 7f6e78ff96c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6e500b56e0 0x7f6e500d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:24.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.737+0000 7f6e7affd6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6e500b56e0 0x7f6e500d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:24.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.737+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f6e680e3dd0 con 0x7f6e7c10f200 2026-02-13T01:25:24.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.737+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6e680aa0b0 con 0x7f6e7c10f200 2026-02-13T01:25:24.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.737+0000 7f6e7affd6c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6e500b56e0 0x7f6e500d5b90 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6c005d10 tx=0x7f6e6c005ca0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:24.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.829+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e7c10fbf0 con 0x7f6e7c10f200 2026-02-13T01:25:24.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.830+0000 7f6e78ff96c0 1 -- 10.20.193.91:0/2029686119 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22799 (secure 0 0 0) 0x7f6e680a9800 con 0x7f6e7c10f200 2026-02-13T01:25:24.830 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:24.830 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":77,"fsid":"7155d718-087a-11f1-982a-d404e6e7d460","created":"2026-02-13T01:22:42.667442+0000","modified":"2026-02-13T01:25:22.622748+0000","last_up_change":"2026-02-13T01:24:55.419630+0000","last_in_change":"2026-02-13T01:24:47.172971+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T01:23:51.498651+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T01:25:10.736175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T01:25:11.959007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1ffbd7ff-7a87-4947-8ce2-ad23813a7754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6802","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6803","nonce":170892896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6804","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6805","nonce":170892896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6808","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6809","nonce":170892896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6806","nonce":170892896},{"type":"v1","addr":"10.20.193.91:6807","nonce":170892896}]},"public_addr":"10.20.193.91:6803/170892896","cluster_addr":"10.20.193.91:6805/170892896","heartbeat_back_addr":"10.20.193.91:6809/170892896","heartbeat_front_addr":"10.20.193.91:6807/170892896","state":["exists","up"]},{"osd":1,"uuid":"5d698ba3-8a17-455c-b05d-8ca1c9d44466","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6801","nonce":1754332231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6803","nonce":1754332231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6807","nonce":1754332231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":1754332231},{"type":"v1","addr":"10.20.193.126:6805","nonce":1754332231}]},"public_addr":"10.20.193.126:6801/1754332231","cluster_addr":"10.20.193.126:6803/1754332231","heartbeat_back_addr":"10.20.193.126:6807/1754332231","heartbeat_front_addr":"10.20.193.126:6805/1754332231","state":["exists","up"]},{"osd":2,"uuid":"4b9d9a44-7956-4117-ada8-cb99016ae048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6800","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6801","nonce":1701976259}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6802","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6803","nonce":1701976259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6806","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6807","nonce":1701976259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6804","nonce":1701976259},{"type":"v1","addr":"10.20.193.154:6805","nonce":1701976259}]},"public_addr":"10.20.193.154:6801/1701976259","cluster_addr":"10.20.193.154:6803/1701976259","heartbeat_back_addr":"10.20.193.154:6807/1701976259","heartbeat_front_addr":"10.20.193.154:6805/1701976259","state":["exists","up"]},{"osd":3,"uuid":"bb667b65-2ce1-4131-88de-53efa7c8fb94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6810","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6811","nonce":746110270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6812","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6813","nonce":746110270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6816","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6817","nonce":746110270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6814","nonce":746110270},{"type":"v1","addr":"10.20.193.91:6815","nonce":746110270}]},"public_addr":"10.20.193.91:6811/746110270","cluster_addr":"10.20.193.91:6813/746110270","heartbeat_back_addr":"10.20.193.91:6817/746110270","heartbeat_front_addr":"10.20.193.91:6815/746110270","state":["exists","up"]},{"osd":4,"uuid":"a2569ae9-0cac-4935-94f5-bfcbd0376cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6809","nonce":2328526761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6811","nonce":2328526761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6815","nonce":2328526761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":2328526761},{"type":"v1","addr":"10.20.193.126:6813","nonce":2328526761}]},"public_addr":"10.20.193.126:6809/2328526761","cluster_addr":"10.20.193.126:6811/2328526761","heartbeat_back_addr":"10.20.193.126:6815/2328526761","heartbeat_front_addr":"10.20.193.126:6813/2328526761","state":["exists","up"]},{"osd":5,"uuid":"6279cc06-cf48-430f-929b-fde87b33e114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6808","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6809","nonce":2892893681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6810","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6811","nonce":2892893681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6814","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6815","nonce":2892893681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6812","nonce":2892893681},{"type":"v1","addr":"10.20.193.154:6813","nonce":2892893681}]},"public_addr":"10.20.193.154:6809/2892893681","cluster_addr":"10.20.193.154:6811/2892893681","heartbeat_back_addr":"10.20.193.154:6815/2892893681","heartbeat_front_addr":"10.20.193.154:6813/2892893681","state":["exists","up"]},{"osd":6,"uuid":"47579bf9-6170-4408-810f-8be850659d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6818","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6819","nonce":1887880552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6820","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6821","nonce":1887880552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6824","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6825","nonce":1887880552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6822","nonce":1887880552},{"type":"v1","addr":"10.20.193.91:6823","nonce":1887880552}]},"public_addr":"10.20.193.91:6819/1887880552","cluster_addr":"10.20.193.91:6821/1887880552","heartbeat_back_addr":"10.20.193.91:6825/1887880552","heartbeat_front_addr":"10.20.193.91:6823/1887880552","state":["exists","up"]},{"osd":7,"uuid":"5ec7f6c4-8479-4e14-855e-fa3b594f058c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6817","nonce":1270299623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6819","nonce":1270299623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6823","nonce":1270299623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":1270299623},{"type":"v1","addr":"10.20.193.126:6821","nonce":1270299623}]},"public_addr":"10.20.193.126:6817/1270299623","cluster_addr":"10.20.193.126:6819/1270299623","heartbeat_back_addr":"10.20.193.126:6823/1270299623","heartbeat_front_addr":"10.20.193.126:6821/1270299623","state":["exists","up"]},{"osd":8,"uuid":"19fbc479-f0bf-46d3-9d48-648388632fb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6816","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6817","nonce":1364755569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6818","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6819","nonce":1364755569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6822","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6823","nonce":1364755569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6820","nonce":1364755569},{"type":"v1","addr":"10.20.193.154:6821","nonce":1364755569}]},"public_addr":"10.20.193.154:6817/1364755569","cluster_addr":"10.20.193.154:6819/1364755569","heartbeat_back_addr":"10.20.193.154:6823/1364755569","heartbeat_front_addr":"10.20.193.154:6821/1364755569","state":["exists","up"]},{"osd":9,"uuid":"a3befdc3-c847-4659-9ec1-0dd5e3172fe7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6826","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6827","nonce":1541303371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6828","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6829","nonce":1541303371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6832","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6833","nonce":1541303371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.91:6830","nonce":1541303371},{"type":"v1","addr":"10.20.193.91:6831","nonce":1541303371}]},"public_addr":"10.20.193.91:6827/1541303371","cluster_addr":"10.20.193.91:6829/1541303371","heartbeat_back_addr":"10.20.193.91:6833/1541303371","heartbeat_front_addr":"10.20.193.91:6831/1541303371","state":["exists","up"]},{"osd":10,"uuid":"36fe781f-9334-474b-bc6b-01e798e72a81","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6825","nonce":3309349280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6827","nonce":3309349280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6831","nonce":3309349280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":3309349280},{"type":"v1","addr":"10.20.193.126:6829","nonce":3309349280}]},"public_addr":"10.20.193.126:6825/3309349280","cluster_addr":"10.20.193.126:6827/3309349280","heartbeat_back_addr":"10.20.193.126:6831/3309349280","heartbeat_front_addr":"10.20.193.126:6829/3309349280","state":["exists","up"]},{"osd":11,"uuid":"5f569e12-4d88-4cf0-8f2e-147ace91f917","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6824","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6825","nonce":1394532940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6826","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6827","nonce":1394532940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6830","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6831","nonce":1394532940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.154:6828","nonce":1394532940},{"type":"v1","addr":"10.20.193.154:6829","nonce":1394532940}]},"public_addr":"10.20.193.154:6825/1394532940","cluster_addr":"10.20.193.154:6827/1394532940","heartbeat_back_addr":"10.20.193.154:6831/1394532940","heartbeat_front_addr":"10.20.193.154:6829/1394532940","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:34.061683+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:40.894443+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:47.963906+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:23:55.184288+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:02.378327+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:09.561223+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:16.947535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:24.187301+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:31.493620+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:38.824765+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:46.268089+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T01:24:53.733044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.3b","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.91:6801/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/624457179":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/335308306":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/3011156600":"2026-02-14T01:23:21.300323+0000","10.20.193.91:0/2950715894":"2026-02-14T01:22:48.728580+0000","10.20.193.91:6801/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/3747672627":"2026-02-14T01:23:21.300323+0000","10.20.193.91:6800/1887900143":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/2063745168":"2026-02-14T01:22:48.728580+0000","10.20.193.91:0/1509443464":"2026-02-14T01:22:48.728580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6e500b56e0 msgr2=0x7f6e500d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6e500b56e0 0x7f6e500d5b90 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6c005d10 tx=0x7f6e6c005ca0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 msgr2=0x7f6e7c0f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 0x7f6e7c0f4c90 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e6800b710 tx=0x7f6e6800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 shutdown_connections 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6e500b56e0 0x7f6e500d5b90 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6e7c0f52c0 0x7f6e7c0fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e7c115410 0x7f6e7c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 --2- 10.20.193.91:0/2029686119 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6e7c10f200 0x7f6e7c0f4c90 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:24.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 >> 10.20.193.91:0/2029686119 conn(0x7f6e7c0ecb00 msgr2=0x7f6e7c111bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:24.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 shutdown_connections 2026-02-13T01:25:24.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:24.831+0000 7f6e81f596c0 1 -- 10.20.193.91:0/2029686119 wait complete. 2026-02-13T01:25:24.873 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T01:25:24.873 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T01:25:24.874 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T01:25:24.874 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T01:25:24.875 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T01:25:24.875 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T01:25:24.876 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T01:25:24.876 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T01:25:24.877 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T01:25:24.877 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T01:25:24.877 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T01:25:24.878 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T01:25:24.903 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:24 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3514582921' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:25:24.903 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:24 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3700022065' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:25:24.903 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:24 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1843805496' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:24.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:24 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3514582921' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:25:24.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:24 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3700022065' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:25:24.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:24 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1843805496' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:25.015 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.016 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.016 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.017 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.017 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.018 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.019 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.020 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.024 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.034 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.049 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.051 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:24 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3514582921' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T01:25:25.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:24 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3700022065' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T01:25:25.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:24 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1843805496' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:25.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/2804463208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440607a0 msgr2=0x7f3c44060b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/2804463208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440607a0 0x7f3c44060b70 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=9631649531563161393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c38009970 tx=0x7f3c3802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/2804463208 shutdown_connections 2026-02-13T01:25:25.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/2804463208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c44155660 0x7f3c44175a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/2804463208 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c440610b0 0x7f3c44155120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/2804463208 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440607a0 0x7f3c44060b70 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=9631649531563161393 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/2804463208 >> 10.20.193.91:0/2804463208 conn(0x7f3c440ea8b0 msgr2=0x7f3c4410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/2804463208 shutdown_connections 2026-02-13T01:25:25.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/2804463208 wait complete. 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 Processor -- start 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.170+0000 7f3c4b7b06c0 1 -- start start 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c440607a0 0x7f3c441614c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440610b0 0x7f3c44161a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c44155660 0x7f3c44166dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44167410 con 0x7f3c440610b0 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44167580 con 0x7f3c44155660 2026-02-13T01:25:25.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44167740 con 0x7f3c440607a0 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440610b0 0x7f3c44161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440610b0 0x7f3c44161a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36768/0 (socket says 10.20.193.91:36768) 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 -- 10.20.193.91:0/3335681936 learned_addr learned my addr 10.20.193.91:0/3335681936 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c495256c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c440607a0 0x7f3c441614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c49d266c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c44155660 0x7f3c44166dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 -- 10.20.193.91:0/3335681936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c440607a0 msgr2=0x7f3c441614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c440607a0 0x7f3c441614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 -- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c44155660 msgr2=0x7f3c44166dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c44155660 0x7f3c44166dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 -- 10.20.193.91:0/3335681936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c38009590 con 0x7f3c440610b0 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c495256c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3c440607a0 0x7f3c441614c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:25.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c48d246c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440610b0 0x7f3c44161a00 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c3400b710 tx=0x7f3c3400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c34004250 con 0x7f3c440610b0 2026-02-13T01:25:25.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3c34002d80 con 0x7f3c440610b0 2026-02-13T01:25:25.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c44167a20 con 0x7f3c440610b0 2026-02-13T01:25:25.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c3400ce20 con 0x7f3c440610b0 2026-02-13T01:25:25.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.171+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c44151290 con 0x7f3c440610b0 2026-02-13T01:25:25.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c44052a50 con 0x7f3c440610b0 2026-02-13T01:25:25.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/1656921728 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10d9a0 msgr2=0x7fbcbc1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/1656921728 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10d9a0 0x7fbcbc1129e0 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=10877418899555696123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcb00099a0 tx=0x7fbcb002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/1656921728 shutdown_connections 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/1656921728 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcbc1131c0 0x7fbcbc173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/1656921728 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10d9a0 0x7fbcbc1129e0 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=10877418899555696123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/1656921728 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcbc10cfb0 0x7fbcbc10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/1656921728 >> 10.20.193.91:0/1656921728 conn(0x7fbcbc0ea8b0 msgr2=0x7fbcbc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/1656921728 shutdown_connections 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/1656921728 wait complete. 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 Processor -- start 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- start start 2026-02-13T01:25:25.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10cfb0 0x7fbcbc0f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcbc1131c0 0x7fbcbc173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcbc0f5270 0x7fbcbc0fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc0f5960 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc0faa80 con 0x7fbcbc1131c0 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc35cc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbcbc0fac40 con 0x7fbcbc0f5270 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc133d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10cfb0 0x7fbcbc0f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc133d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10cfb0 0x7fbcbc0f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36776/0 (socket says 10.20.193.91:36776) 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.172+0000 7fbcc133d6c0 1 -- 10.20.193.91:0/3872581699 learned_addr learned my addr 10.20.193.91:0/3872581699 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc1b3e6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcbc0f5270 0x7fbcbc0fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc0b3c6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcbc1131c0 0x7fbcbc173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc133d6c0 1 -- 10.20.193.91:0/3872581699 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcbc0f5270 msgr2=0x7fbcbc0fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc133d6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbcbc0f5270 0x7fbcbc0fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc133d6c0 1 -- 10.20.193.91:0/3872581699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcbc1131c0 msgr2=0x7fbcbc173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc133d6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcbc1131c0 0x7fbcbc173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc133d6c0 1 -- 10.20.193.91:0/3872581699 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb0009590 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc133d6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10cfb0 0x7fbcbc0f4c40 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcac009490 tx=0x7fbcac00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcac004a80 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcbc0faf20 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbcac009030 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcac00cdd0 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcbc0fb6b0 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.173+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3c340043b0 con 0x7f3c440610b0 2026-02-13T01:25:25.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.174+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcbc052a50 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.174+0000 7f3c327fc6c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3c200b5760 0x7f3c200d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.174+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f3c340e3d80 con 0x7f3c440610b0 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c327fc6c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] conn(0x7f3c200dd2b0 0x7f3c200fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 --> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c200fde10 con 0x7f3c200dd2b0 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f3c340e4130 con 0x7f3c440610b0 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c495256c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3c200b5760 0x7f3c200d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c49d266c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] conn(0x7f3c200dd2b0 0x7f3c200fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fbcac004060 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c495256c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3c200b5760 0x7f3c200d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c380098c0 tx=0x7f3c38009230 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7fbcaa7fc6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc980b56e0 0x7fbc980d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fbcac0e3e70 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7fbcaa7fc6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] conn(0x7fbc980dd230 0x7fbc980fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 --> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc980fdd90 con 0x7fbc980dd230 2026-02-13T01:25:25.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7f3c49d266c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] conn(0x7f3c200dd2b0 0x7f3c200fd740 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.175+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fbcac0e6490 con 0x7fbcbc10cfb0 2026-02-13T01:25:25.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.176+0000 7fbcc1b3e6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] conn(0x7fbc980dd230 0x7fbc980fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.176+0000 7fbcc0b3c6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc980b56e0 0x7fbc980d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.176+0000 7fbcc1b3e6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] conn(0x7fbc980dd230 0x7fbc980fd6c0 crc :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.176+0000 7fbcc0b3c6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc980b56e0 0x7fbc980d5b90 secure :-1 s=READY pgs=156 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcb0005b40 tx=0x7fbcb0005c40 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.176+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== osd.7 v2:10.20.193.126:6816/1270299623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f3c200fde10 con 0x7f3c200dd2b0 2026-02-13T01:25:25.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== osd.6 v2:10.20.193.91:6818/1887880552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fbc980fdd90 con 0x7fbc980dd230 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2118102441 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 msgr2=0x7fba3010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2118102441 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3010f600 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=13734362274435136302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba1c0099a0 tx=0x7fba1c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2118102441 shutdown_connections 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2118102441 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fba30115440 0x7fba30175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2118102441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba3010fc20 0x7fba30114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2118102441 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3010f600 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=13734362274435136302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2118102441 >> 10.20.193.91:0/2118102441 conn(0x7fba300ecb30 msgr2=0x7fba3010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2118102441 shutdown_connections 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2118102441 wait complete. 2026-02-13T01:25:25.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.177+0000 7fba35eb96c0 1 Processor -- start 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 -- start start 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3005e4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fba30115440 0x7fba30175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba3005a740 0x7fba3005abe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fba3005b1f0 con 0x7fba3010f230 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3005e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3005e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36816/0 (socket says 10.20.193.91:36816) 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 -- 10.20.193.91:0/2377426299 learned_addr learned my addr 10.20.193.91:0/2377426299 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fba3005b360 con 0x7fba3005a740 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba3005b520 con 0x7fba30115440 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2effd6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fba30115440 0x7fba30175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2ffff6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba3005a740 0x7fba3005abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 -- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fba30115440 msgr2=0x7fba30175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fba30115440 0x7fba30175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 -- 10.20.193.91:0/2377426299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba3005a740 msgr2=0x7fba3005abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba3005a740 0x7fba3005abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1c009590 con 0x7fba3010f230 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2f7fe6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3005e4e0 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba1c02f230 tx=0x7fba1c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba1c002ba0 con 0x7fba3010f230 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fba1c007680 con 0x7fba3010f230 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba1c037480 con 0x7fba3010f230 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba30101430 con 0x7fba3010f230 2026-02-13T01:25:25.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.178+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba30101800 con 0x7fba3010f230 2026-02-13T01:25:25.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 -- 10.20.193.91:0/3889642762 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee010fc20 msgr2=0x7efee0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 --2- 10.20.193.91:0/3889642762 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee010fc20 0x7efee0114c60 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=13057818046008982783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec80098d0 tx=0x7efec802ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:25.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba30052a50 con 0x7fba3010f230 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 -- 10.20.193.91:0/356581846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010b1f0 msgr2=0x7f140010b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 --2- 10.20.193.91:0/356581846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010b1f0 0x7f140010b5c0 secure :-1 s=READY pgs=65 gs=2 cs=0 l=1 c_cookie=14818368140672391310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13f0009970 tx=0x7f13f002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 -- 10.20.193.91:0/356581846 shutdown_connections 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 --2- 10.20.193.91:0/356581846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1400153420 0x7f1400173800 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 --2- 10.20.193.91:0/356581846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f140010bb00 0x7f1400152ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 --2- 10.20.193.91:0/356581846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010b1f0 0x7f140010b5c0 unknown :-1 s=CLOSED pgs=65 gs=2 cs=0 l=1 c_cookie=14818368140672391310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 -- 10.20.193.91:0/356581846 >> 10.20.193.91:0/356581846 conn(0x7f1400063af0 msgr2=0x7f14000642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 -- 10.20.193.91:0/356581846 shutdown_connections 2026-02-13T01:25:25.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7f140818d6c0 1 -- 10.20.193.91:0/356581846 wait complete. 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 -- 10.20.193.91:0/3889642762 shutdown_connections 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 --2- 10.20.193.91:0/3889642762 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efee0115440 0x7efee0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 --2- 10.20.193.91:0/3889642762 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee010fc20 0x7efee0114c60 unknown :-1 s=CLOSED pgs=70 gs=2 cs=0 l=1 c_cookie=13057818046008982783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 --2- 10.20.193.91:0/3889642762 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efee010f230 0x7efee010f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 -- 10.20.193.91:0/3889642762 >> 10.20.193.91:0/3889642762 conn(0x7efee00ecb30 msgr2=0x7efee010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 -- 10.20.193.91:0/3889642762 shutdown_connections 2026-02-13T01:25:25.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.179+0000 7efee4c816c0 1 -- 10.20.193.91:0/3889642762 wait complete. 2026-02-13T01:25:25.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 Processor -- start 2026-02-13T01:25:25.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 -- start start 2026-02-13T01:25:25.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f140010b1f0 0x7f140015f2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010bb00 0x7f140015f810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1400153420 0x7f1400164bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1400165220 con 0x7f1400153420 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1400165390 con 0x7f140010bb00 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f140818d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1400165550 con 0x7f140010b1f0 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f1405efe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f140010b1f0 0x7f140015f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1400153420 0x7f1400164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7efee4c816c0 1 Processor -- start 2026-02-13T01:25:25.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f1405efe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f140010b1f0 0x7f140015f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51494/0 (socket says 10.20.193.91:51494) 2026-02-13T01:25:25.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f1405efe6c0 1 -- 10.20.193.91:0/2366736986 learned_addr learned my addr 10.20.193.91:0/2366736986 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14056fd6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010bb00 0x7f140015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7efee4c816c0 1 -- start start 2026-02-13T01:25:25.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 -- 10.20.193.91:0/2366736986 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f140010b1f0 msgr2=0x7f140015f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f140010b1f0 0x7f140015f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 -- 10.20.193.91:0/2366736986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010bb00 msgr2=0x7f140015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f140010bb00 0x7f140015f810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 -- 10.20.193.91:0/2366736986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f40094c0 con 0x7f1400153420 2026-02-13T01:25:25.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f14066ff6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1400153420 0x7f1400164bd0 secure :-1 s=READY pgs=260 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140010c1d0 tx=0x7f13fc00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13fc005280 con 0x7f1400153420 2026-02-13T01:25:25.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f13fc003cd0 con 0x7f1400153420 2026-02-13T01:25:25.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f0009590 con 0x7f1400153420 2026-02-13T01:25:25.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f140014eea0 con 0x7f1400153420 2026-02-13T01:25:25.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efee4c816c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efee010f230 0x7efee00f4cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efee4c816c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efee0115440 0x7efee0175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efee4c816c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee00f52e0 0x7efee00fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efee4c816c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7efee00f59d0 con 0x7efee010f230 2026-02-13T01:25:25.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efee4c816c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efee00faaf0 con 0x7efee0115440 2026-02-13T01:25:25.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efee4c816c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7efee00facb0 con 0x7efee00f52e0 2026-02-13T01:25:25.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fba1c002d00 con 0x7fba3010f230 2026-02-13T01:25:25.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7faf25ce46c0 1 -- 10.20.193.91:0/2308300541 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf2010fc20 msgr2=0x7faf20114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.180+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/2308300541 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf2010fc20 0x7faf20114c60 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=458769057207180687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf100099a0 tx=0x7faf1002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee00f52e0 0x7efee00fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee00f52e0 0x7efee00fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51522/0 (socket says 10.20.193.91:51522) 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 -- 10.20.193.91:0/2347050172 learned_addr learned my addr 10.20.193.91:0/2347050172 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 -- 10.20.193.91:0/2347050172 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efee0115440 msgr2=0x7efee0175ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efee0115440 0x7efee0175ce0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 -- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efee010f230 msgr2=0x7efee00f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efede5756c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efee010f230 0x7efee00f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efee010f230 0x7efee00f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13fc00db70 con 0x7f1400153420 2026-02-13T01:25:25.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1400052a50 con 0x7f1400153420 2026-02-13T01:25:25.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efeded766c0 1 -- 10.20.193.91:0/2347050172 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed4009590 con 0x7efee00f52e0 2026-02-13T01:25:25.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7efede5756c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7efee010f230 0x7efee00f4cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 -- 10.20.193.91:0/2308300541 shutdown_connections 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/2308300541 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf20115440 0x7faf20175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/2308300541 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf2010fc20 0x7faf20114c60 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=458769057207180687 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/2308300541 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf2010f230 0x7faf2010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 -- 10.20.193.91:0/2308300541 >> 10.20.193.91:0/2308300541 conn(0x7faf200ecb30 msgr2=0x7faf2010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 -- 10.20.193.91:0/2308300541 shutdown_connections 2026-02-13T01:25:25.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7faf25ce46c0 1 -- 10.20.193.91:0/2308300541 wait complete. 2026-02-13T01:25:25.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.181+0000 7fba2cff96c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fba040b5760 0x7fba040d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fba1c107e60 con 0x7fba3010f230 2026-02-13T01:25:25.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2effd6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fba040b5760 0x7fba040d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2cff96c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] conn(0x7fba040dd2b0 0x7fba040fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba040fde10 con 0x7fba040dd2b0 2026-02-13T01:25:25.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fba1c108210 con 0x7fba3010f230 2026-02-13T01:25:25.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7faf25ce46c0 1 Processor -- start 2026-02-13T01:25:25.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2effd6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fba040b5760 0x7fba040d5c10 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba3005e250 tx=0x7fba20005e60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2ffff6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] conn(0x7fba040dd2b0 0x7fba040fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7faf25ce46c0 1 -- start start 2026-02-13T01:25:25.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7efeded766c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee00f52e0 0x7efee00fa5b0 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efed000c9b0 tx=0x7efed000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/4111020651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 msgr2=0x7f9a4c173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 --2- 10.20.193.91:0/4111020651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c173b60 secure :-1 s=READY pgs=261 gs=3 cs=0 l=1 c_cookie=13505381761534287014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a4000aa70 tx=0x7f9a4002fe00 comp rx=0 tx=0).stop 2026-02-13T01:25:25.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/4111020651 shutdown_connections 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 --2- 10.20.193.91:0/4111020651 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c173b60 unknown :-1 s=CLOSED pgs=261 gs=3 cs=0 l=1 c_cookie=13505381761534287014 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 --2- 10.20.193.91:0/4111020651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a4c10d9a0 0x7f9a4c1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 --2- 10.20.193.91:0/4111020651 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9a4c10cfb0 0x7f9a4c10d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/4111020651 >> 10.20.193.91:0/4111020651 conn(0x7f9a4c0ea8b0 msgr2=0x7f9a4c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/4111020651 shutdown_connections 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/4111020651 wait complete. 2026-02-13T01:25:25.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7faf25ce46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf2010f230 0x7faf200f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efed0003c40 con 0x7efee00f52e0 2026-02-13T01:25:25.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7efed0003da0 con 0x7efee00f52e0 2026-02-13T01:25:25.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efed00081c0 con 0x7efee00f52e0 2026-02-13T01:25:25.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec80094c0 con 0x7efee00f52e0 2026-02-13T01:25:25.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee00fb230 con 0x7efee00f52e0 2026-02-13T01:25:25.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 Processor -- start 2026-02-13T01:25:25.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf20115440 0x7faf20175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf200f52c0 0x7faf200fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 -- start start 2026-02-13T01:25:25.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7faf200f5920 con 0x7faf200f52c0 2026-02-13T01:25:25.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf200faa80 con 0x7faf20115440 2026-02-13T01:25:25.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7faf200fac40 con 0x7faf2010f230 2026-02-13T01:25:25.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf20115440 0x7faf20175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf200f52c0 0x7faf200fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf20115440 0x7faf20175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:52366/0 (socket says 10.20.193.91:52366) 2026-02-13T01:25:25.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9a4c10cfb0 0x7f9a4c060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 -- 10.20.193.91:0/3189326839 learned_addr learned my addr 10.20.193.91:0/3189326839 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.182+0000 7fba2ffff6c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] conn(0x7fba040dd2b0 0x7fba040fd740 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a4c061180 0x7f9a4c163200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c163740 con 0x7f9a4c1131c0 2026-02-13T01:25:25.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c1638b0 con 0x7f9a4c061180 2026-02-13T01:25:25.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a51ab46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c163a70 con 0x7f9a4c10cfb0 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36868/0 (socket says 10.20.193.91:36868) 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 -- 10.20.193.91:0/3182627426 learned_addr learned my addr 10.20.193.91:0/3182627426 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4b7fe6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9a4c10cfb0 0x7f9a4c060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4bfff6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a4c061180 0x7f9a4c163200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 -- 10.20.193.91:0/3189326839 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf2010f230 msgr2=0x7faf200f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faf2010f230 0x7faf200f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 -- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf200f52c0 msgr2=0x7faf200fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf200f52c0 0x7faf200fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 -- 10.20.193.91:0/3189326839 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf10009590 con 0x7faf20115440 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1ffff6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faf200f52c0 0x7faf200fa540 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 -- 10.20.193.91:0/3182627426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9a4c10cfb0 msgr2=0x7f9a4c060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9a4c10cfb0 0x7f9a4c060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 -- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a4c061180 msgr2=0x7f9a4c163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a4c061180 0x7f9a4c163200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 -- 10.20.193.91:0/3182627426 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4000a660 con 0x7f9a4c1131c0 2026-02-13T01:25:25.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7f9a4affd6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c060c40 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a3c005dc0 tx=0x7f9a3c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1effd6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf20115440 0x7faf20175ce0 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf100023a0 tx=0x7faf1002fb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf10002ae0 con 0x7faf20115440 2026-02-13T01:25:25.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf200fae60 con 0x7faf20115440 2026-02-13T01:25:25.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf200fb330 con 0x7faf20115440 2026-02-13T01:25:25.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7faf10007680 con 0x7faf20115440 2026-02-13T01:25:25.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf10036310 con 0x7faf20115440 2026-02-13T01:25:25.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a3c004250 con 0x7f9a4c1131c0 2026-02-13T01:25:25.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9a3c009070 con 0x7f9a4c1131c0 2026-02-13T01:25:25.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/3182627426 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c163d50 con 0x7f9a4c1131c0 2026-02-13T01:25:25.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a3c00cd50 con 0x7f9a4c1131c0 2026-02-13T01:25:25.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf20052a50 con 0x7faf20115440 2026-02-13T01:25:25.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f9a51ab46c0 1 -- 10.20.193.91:0/3182627426 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c164280 con 0x7f9a4c1131c0 2026-02-13T01:25:25.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efed0005030 con 0x7efee00f52e0 2026-02-13T01:25:25.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f13fc00dd20 con 0x7f1400153420 2026-02-13T01:25:25.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a14000fe0 con 0x7f9a4c1131c0 2026-02-13T01:25:25.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 --> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c4415a4f0 con 0x7f3c200dd2b0 2026-02-13T01:25:25.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.183+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== osd.2 v2:10.20.193.154:6800/1701976259 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fba040fde10 con 0x7fba040dd2b0 2026-02-13T01:25:25.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efee0052a50 con 0x7efee00f52e0 2026-02-13T01:25:25.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.184+0000 7f3c327fc6c0 1 -- 10.20.193.91:0/3335681936 <== osd.7 v2:10.20.193.126:6816/1270299623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3c4415a4f0 con 0x7f3c200dd2b0 2026-02-13T01:25:25.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] conn(0x7f3c200dd2b0 msgr2=0x7f3c200fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.126:6816/1270299623,v1:10.20.193.126:6817/1270299623] conn(0x7f3c200dd2b0 0x7f3c200fd740 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f13eeffd6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f13dc0b5660 0x7f13dc0d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efec77fe6c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efeb80b5830 0x7efeb80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 --> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbcbc1770a0 con 0x7fbc980dd230 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f13fc0e4b10 con 0x7f1400153420 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efede5756c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efeb80b5830 0x7efeb80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3c200b5760 msgr2=0x7f3c200d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3c200b5760 0x7f3c200d5c10 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c380098c0 tx=0x7f3c38009230 comp rx=0 tx=0).stop 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440610b0 msgr2=0x7f3c44161a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 --2- 10.20.193.91:0/3335681936 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3c440610b0 0x7f3c44161a00 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c3400b710 tx=0x7f3c3400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c49d266c0 1 -- 10.20.193.91:0/3335681936 reap_dead start 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 shutdown_connections 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 >> 10.20.193.91:0/3335681936 conn(0x7f3c440ea8b0 msgr2=0x7f3c4410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 shutdown_connections 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f3c4b7b06c0 1 -- 10.20.193.91:0/3335681936 wait complete. 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7efed00e4d10 con 0x7efee00f52e0 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efec77fe6c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] conn(0x7efeb80dd370 0x7efeb80fd800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 --> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efeb80fded0 con 0x7efeb80dd370 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7efed00e7350 con 0x7efee00f52e0 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efede5756c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efeb80b5830 0x7efeb80d5ce0 secure :-1 s=READY pgs=158 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efed4005fd0 tx=0x7efed4009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7fbcaa7fc6c0 1 -- 10.20.193.91:0/3872581699 <== osd.6 v2:10.20.193.91:6818/1887880552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbcbc1770a0 con 0x7fbc980dd230 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f1405efe6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f13dc0b5660 0x7f13dc0d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f13eeffd6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] conn(0x7f13dc0dd040 0x7f13dc0fd4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 --> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13dc0fdba0 con 0x7f13dc0dd040 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f13fc0e4e80 con 0x7f1400153420 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f14056fd6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] conn(0x7f13dc0dd040 0x7f13dc0fd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f1405efe6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f13dc0b5660 0x7f13dc0d5b10 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13f00023e0 tx=0x7f13f0005ae0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7f14056fd6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] conn(0x7f13dc0dd040 0x7f13dc0fd4d0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7efeddd746c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] conn(0x7efeb80dd370 0x7efeb80fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.185+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7faf100071c0 con 0x7faf20115440 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1cff96c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faef40b5760 0x7faef40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== osd.3 v2:10.20.193.91:6810/746110270 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f13dc0fdba0 con 0x7f13dc0dd040 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7faf10107eb0 con 0x7faf20115440 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1f7fe6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faef40b5760 0x7faef40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1cff96c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] conn(0x7faef40dd2a0 0x7faef40fd730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 --> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faef40fde00 con 0x7faef40dd2a0 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7faf10108260 con 0x7faf20115440 2026-02-13T01:25:25.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9a3c0028c0 con 0x7f9a4c1131c0 2026-02-13T01:25:25.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1ffff6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] conn(0x7faef40dd2a0 0x7faef40fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7faf1f7fe6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faef40b5760 0x7faef40d5c10 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf0c004750 tx=0x7faf0c005e10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.186+0000 7efeddd746c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] conn(0x7efeb80dd370 0x7efeb80fd800 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] conn(0x7fbc980dd230 msgr2=0x7fbc980fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6818/1887880552,v1:10.20.193.91:6819/1887880552] conn(0x7fbc980dd230 0x7fbc980fd6c0 crc :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7faf1ffff6c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] conn(0x7faef40dd2a0 0x7faef40fd730 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc980b56e0 msgr2=0x7fbc980d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbc980b56e0 0x7fbc980d5b90 secure :-1 s=READY pgs=156 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcb0005b40 tx=0x7fbcb0005c40 comp rx=0 tx=0).stop 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10cfb0 msgr2=0x7fbcbc0f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 --2- 10.20.193.91:0/3872581699 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbcbc10cfb0 0x7fbcbc0f4c40 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcac009490 tx=0x7fbcac00bc50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc1b3e6c0 1 -- 10.20.193.91:0/3872581699 reap_dead start 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== osd.11 v2:10.20.193.154:6824/1394532940 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7efeb80fded0 con 0x7efeb80dd370 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 shutdown_connections 2026-02-13T01:25:25.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 >> 10.20.193.91:0/3872581699 conn(0x7fbcbc0ea8b0 msgr2=0x7fbcbc1118a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a48ff96c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9a200b57e0 0x7f9a200d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f9a3c0e3bc0 con 0x7f9a4c1131c0 2026-02-13T01:25:25.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a4b7fe6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9a200b57e0 0x7f9a200d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== osd.10 v2:10.20.193.126:6824/3309349280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7faef40fde00 con 0x7faef40dd2a0 2026-02-13T01:25:25.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a48ff96c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] conn(0x7f9a200dd330 0x7f9a200fd7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 --> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a200fde90 con 0x7f9a200dd330 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9a3c0e3ef0 con 0x7f9a4c1131c0 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.187+0000 7f9a4b7fe6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9a200b57e0 0x7f9a200d5c90 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a38004750 tx=0x7f9a38009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.188+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 shutdown_connections 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.188+0000 7fbcc35cc6c0 1 -- 10.20.193.91:0/3872581699 wait complete. 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.188+0000 7f9a4bfff6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] conn(0x7f9a200dd330 0x7f9a200fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.188+0000 7f9a4bfff6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] conn(0x7f9a200dd330 0x7f9a200fd7c0 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1150240346 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c115440 msgr2=0x7fdd2c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd2affd6c0 1 -- 10.20.193.91:0/1150240346 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd2002fd60 con 0x7fdd2c115440 2026-02-13T01:25:25.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 --2- 10.20.193.91:0/1150240346 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c115440 0x7fdd2c175de0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=4888292391912566399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd200099a0 tx=0x7fdd2002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== osd.4 v2:10.20.193.126:6808/2328526761 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f9a200fde90 con 0x7f9a200dd330 2026-02-13T01:25:25.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1150240346 shutdown_connections 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 --2- 10.20.193.91:0/1150240346 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c115440 0x7fdd2c175de0 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=4888292391912566399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 --2- 10.20.193.91:0/1150240346 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdd2c10fc20 0x7fdd2c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 --2- 10.20.193.91:0/1150240346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd2c10f230 0x7fdd2c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1150240346 >> 10.20.193.91:0/1150240346 conn(0x7fdd2c0ecb30 msgr2=0x7fdd2c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1150240346 shutdown_connections 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.189+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1150240346 wait complete. 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 Processor -- start 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 -- start start 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c10f230 0x7fdd2c0f4b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdd2c115440 0x7fdd2c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd2c0f5160 0x7fdd2c0fa430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0f57c0 con 0x7fdd2c10f230 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0fa970 con 0x7fdd2c0f5160 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd324cf6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c0fab30 con 0x7fdd2c115440 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c10f230 0x7fdd2c0f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c10f230 0x7fdd2c0f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36896/0 (socket says 10.20.193.91:36896) 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 -- 10.20.193.91:0/1471033338 learned_addr learned my addr 10.20.193.91:0/1471033338 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd30a416c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd2c0f5160 0x7fdd2c0fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 -- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdd2c115440 msgr2=0x7fdd2c175ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fdd2c115440 0x7fdd2c175ce0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 -- 10.20.193.91:0/1471033338 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd2c0f5160 msgr2=0x7fdd2c0fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd2c0f5160 0x7fdd2c0fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 -- 10.20.193.91:0/1471033338 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd20009590 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.190+0000 7fdd2bfff6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c10f230 0x7fdd2c0f4b30 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd1c00c800 tx=0x7fdd1c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.191+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd1c003c40 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.191+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdd1c00a0f0 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.191+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd1c00dca0 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.191+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1471033338 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c0fadb0 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.191+0000 7fdd324cf6c0 1 -- 10.20.193.91:0/1471033338 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c0fb240 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.191+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcf4000fe0 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fdd1c005030 con 0x7fdd2c10f230 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 --> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba30052a50 con 0x7fba040dd2b0 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/2539673956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 msgr2=0x7f46cc179ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/2539673956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc179ee0 secure :-1 s=READY pgs=265 gs=3 cs=0 l=1 c_cookie=12245978430712440963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc00aca0 tx=0x7f46bc030040 comp rx=0 tx=0).stop 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/2539673956 shutdown_connections 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/2539673956 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc179ee0 unknown :-1 s=CLOSED pgs=265 gs=3 cs=0 l=1 c_cookie=12245978430712440963 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/2539673956 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f46cc062fd0 0x7f46cc063400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.192+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/2539673956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46cc0669a0 0x7f46cc0629b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/2539673956 >> 10.20.193.91:0/2539673956 conn(0x7f46cc0ecb30 msgr2=0x7f46cc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/2539673956 shutdown_connections 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/2539673956 wait complete. 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 Processor -- start 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- start start 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fba2cff96c0 1 -- 10.20.193.91:0/2377426299 <== osd.2 v2:10.20.193.154:6800/1701976259 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fba30052a50 con 0x7fba040dd2b0 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fdd297fa6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fdd080b56e0 0x7fdd080d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fdd1c0e4dd0 con 0x7fdd2c10f230 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fdd297fa6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] conn(0x7fdd080dd230 0x7fdd080fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 --> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd080fdd90 con 0x7fdd080dd230 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdd1c0e51f0 con 0x7fdd2c10f230 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7fdd30a416c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] conn(0x7fdd080dd230 0x7fdd080fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] conn(0x7fba040dd2b0 msgr2=0x7fba040fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.154:6800/1701976259,v1:10.20.193.154:6801/1701976259] conn(0x7fba040dd2b0 0x7fba040fd740 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fdd30a416c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] conn(0x7fdd080dd230 0x7fdd080fd6c0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fba040b5760 msgr2=0x7fba040d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fba040b5760 0x7fba040d5c10 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba3005e250 tx=0x7fba20005e60 comp rx=0 tx=0).stop 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 msgr2=0x7fba3005e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 --2- 10.20.193.91:0/2377426299 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fba3010f230 0x7fba3005e4e0 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba1c02f230 tx=0x7fba1c02fd40 comp rx=0 tx=0).stop 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba2ffff6c0 1 -- 10.20.193.91:0/2377426299 reap_dead start 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f46cc062fd0 0x7f46cc163180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc1636c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46cc168a80 0x7f46cc168f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 shutdown_connections 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 >> 10.20.193.91:0/2377426299 conn(0x7fba300ecb30 msgr2=0x7fba300ecf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46c9d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc1636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46c9d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc1636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36918/0 (socket says 10.20.193.91:36918) 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46c9d746c0 1 -- 10.20.193.91:0/3182691237 learned_addr learned my addr 10.20.193.91:0/3182691237 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc169490 con 0x7f46cc159a80 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc169600 con 0x7f46cc168a80 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1697c0 con 0x7f46cc062fd0 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.193+0000 7f46ca5756c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f46cc062fd0 0x7f46cc163180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 shutdown_connections 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fba35eb96c0 1 -- 10.20.193.91:0/2377426299 wait complete. 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46cad766c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46cc168a80 0x7f46cc168f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46c9d746c0 1 -- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f46cc062fd0 msgr2=0x7f46cc163180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46c9d746c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f46cc062fd0 0x7f46cc163180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46c9d746c0 1 -- 10.20.193.91:0/3182691237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46cc168a80 msgr2=0x7f46cc168f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46c9d746c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46cc168a80 0x7f46cc168f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46c9d746c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc00a660 con 0x7f46cc159a80 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46cad766c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46cc168a80 0x7f46cc168f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46c9d746c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc1636c0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46b400b750 tx=0x7f46b400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46b401dd10 con 0x7f46cc159a80 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc157940 con 0x7f46cc159a80 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f46b401de70 con 0x7f46cc159a80 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46b4005330 con 0x7f46cc159a80 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc157dd0 con 0x7f46cc159a80 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== osd.8 v2:10.20.193.154:6816/1364755569 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fdd080fdd90 con 0x7fdd080dd230 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.194+0000 7fdd2b7fe6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fdd080b56e0 0x7fdd080d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7fdd2b7fe6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fdd080b56e0 0x7fdd080d5b90 secure :-1 s=READY pgs=162 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd2c0fb4c0 tx=0x7fdd14006ce0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 --> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efee01792f0 con 0x7efeb80dd370 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 --> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf201792a0 con 0x7faef40dd2a0 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 --> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f140010ab70 con 0x7f13dc0dd040 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7faf1cff96c0 1 -- 10.20.193.91:0/3189326839 <== osd.10 v2:10.20.193.126:6824/3309349280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf201792a0 con 0x7faef40dd2a0 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7efec77fe6c0 1 -- 10.20.193.91:0/2347050172 <== osd.11 v2:10.20.193.154:6824/1394532940 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efee01792f0 con 0x7efeb80dd370 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7f13eeffd6c0 1 -- 10.20.193.91:0/2366736986 <== osd.3 v2:10.20.193.91:6810/746110270 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f140010ab70 con 0x7f13dc0dd040 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] conn(0x7faef40dd2a0 msgr2=0x7faef40fd730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:6824/3309349280,v1:10.20.193.126:6825/3309349280] conn(0x7faef40dd2a0 0x7faef40fd730 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faef40b5760 msgr2=0x7faef40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faef40b5760 0x7faef40d5c10 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf0c004750 tx=0x7faf0c005e10 comp rx=0 tx=0).stop 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf20115440 msgr2=0x7faf20175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 --2- 10.20.193.91:0/3189326839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf20115440 0x7faf20175ce0 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf100023a0 tx=0x7faf1002fb70 comp rx=0 tx=0).stop 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf1ffff6c0 1 -- 10.20.193.91:0/3189326839 reap_dead start 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] conn(0x7f13dc0dd040 msgr2=0x7f13dc0fd4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6810/746110270,v1:10.20.193.91:6811/746110270] conn(0x7f13dc0dd040 0x7f13dc0fd4d0 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f13dc0b5660 msgr2=0x7f13dc0d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f13dc0b5660 0x7f13dc0d5b10 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13f00023e0 tx=0x7f13f0005ae0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1400153420 msgr2=0x7f1400164bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 --2- 10.20.193.91:0/2366736986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1400153420 0x7f1400164bd0 secure :-1 s=READY pgs=260 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140010c1d0 tx=0x7f13fc00cb60 comp rx=0 tx=0).stop 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f14066ff6c0 1 -- 10.20.193.91:0/2366736986 reap_dead start 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 shutdown_connections 2026-02-13T01:25:25.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 >> 10.20.193.91:0/2366736986 conn(0x7f1400063af0 msgr2=0x7f140010a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 shutdown_connections 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f140818d6c0 1 -- 10.20.193.91:0/2366736986 wait complete. 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 shutdown_connections 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 >> 10.20.193.91:0/3189326839 conn(0x7faf200ecb30 msgr2=0x7faf2010d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 shutdown_connections 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7faf25ce46c0 1 -- 10.20.193.91:0/3189326839 wait complete. 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] conn(0x7efeb80dd370 msgr2=0x7efeb80fd800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7efee4c816c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:6824/1394532940,v1:10.20.193.154:6825/1394532940] conn(0x7efeb80dd370 0x7efeb80fd800 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.195+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46cc052a50 con 0x7f46cc159a80 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.196+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f46b4005490 con 0x7f46cc159a80 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 -- 10.20.193.91:0/1845663714 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010d000 msgr2=0x7f884010d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 --2- 10.20.193.91:0/1845663714 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010d000 0x7f884010d3d0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=15300270044843193811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88340099a0 tx=0x7f883402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 -- 10.20.193.91:0/1845663714 shutdown_connections 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 --2- 10.20.193.91:0/1845663714 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f88401131c0 0x7f8840173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 --2- 10.20.193.91:0/1845663714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f884010d9f0 0x7f88401129e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 --2- 10.20.193.91:0/1845663714 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f884010d000 0x7f884010d3d0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=15300270044843193811 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 -- 10.20.193.91:0/1845663714 >> 10.20.193.91:0/1845663714 conn(0x7f8840065870 msgr2=0x7f884010b060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 -- 10.20.193.91:0/1845663714 shutdown_connections 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 -- 10.20.193.91:0/1845663714 wait complete. 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 --> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a14002d20 con 0x7f9a200dd330 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f9a48ff96c0 1 -- 10.20.193.91:0/3182627426 <== osd.4 v2:10.20.193.126:6808/2328526761 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9a14002d20 con 0x7f9a200dd330 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 Processor -- start 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 -- start start 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f884010d000 0x7f884011b0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f88456486c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f88401131c0 0x7f884011b600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] conn(0x7f9a200dd330 msgr2=0x7f9a200fd7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f9a267fc6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.126:6808/2328526761,v1:10.20.193.126:6809/2328526761] conn(0x7f9a200dd330 0x7f9a200fd7c0 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f46b37fe6c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46a40b55e0 0x7f46a40d5a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f46b40f51f0 con 0x7f46cc159a80 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f46b37fe6c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] conn(0x7f46a40dcfc0 0x7f46a40fd450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46a40fdb20 con 0x7f46a40dcfc0 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f46b40f5610 con 0x7f46cc159a80 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f88401131c0 0x7f884011b600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f88401131c0 0x7f884011b600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36948/0 (socket says 10.20.193.91:36948) 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 -- 10.20.193.91:0/29711936 learned_addr learned my addr 10.20.193.91:0/29711936 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f88456486c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f88401209c0 0x7f8840120e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f88401213d0 con 0x7f88401131c0 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8840121540 con 0x7f884010d000 2026-02-13T01:25:25.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8840121700 con 0x7f88401209c0 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f46cad766c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] conn(0x7f46a40dcfc0 0x7f46a40fd450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f46ca5756c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46a40b55e0 0x7f46a40d5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/2663244106 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 msgr2=0x7f2b98063400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/2663244106 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 0x7f2b98063400 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=17411870385004658401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b84009970 tx=0x7f2b8402ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/2663244106 shutdown_connections 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/2663244106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b98159a80 0x7f2b98179ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/2663244106 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 0x7f2b98063400 unknown :-1 s=CLOSED pgs=72 gs=2 cs=0 l=1 c_cookie=17411870385004658401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/2663244106 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b980669a0 0x7f2b980629b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/2663244106 >> 10.20.193.91:0/2663244106 conn(0x7f2b980ecb30 msgr2=0x7f2b9810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/2663244106 shutdown_connections 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.197+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/2663244106 wait complete. 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 Processor -- start 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883f7fe6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f88401209c0 0x7f8840120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 -- 10.20.193.91:0/29711936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f88401209c0 msgr2=0x7f8840120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f88401209c0 0x7f8840120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 -- 10.20.193.91:0/29711936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f884010d000 msgr2=0x7f884011b0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f884010d000 0x7f884011b0c0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8834009590 con 0x7f88401131c0 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f46cad766c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] conn(0x7f46a40dcfc0 0x7f46a40fd450 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f883e7fc6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f88401131c0 0x7f884011b600 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8828006f30 tx=0x7f882800bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9a200b57e0 msgr2=0x7f9a200d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9a200b57e0 0x7f9a200d5c90 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a38004750 tx=0x7f9a38009390 comp rx=0 tx=0).stop 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 -- start start 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 0x7f2b98163360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b98159a80 0x7f2b981638a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b98168c60 0x7f2b98169100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98169670 con 0x7f2b98168c60 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981697e0 con 0x7f2b98159a80 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b9d1c46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b981699a0 con 0x7f2b98062fd0 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b98168c60 0x7f2b98169100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b98168c60 0x7f2b98169100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36964/0 (socket says 10.20.193.91:36964) 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 -- 10.20.193.91:0/3288521726 learned_addr learned my addr 10.20.193.91:0/3288521726 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b965756c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b98159a80 0x7f2b981638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b96d766c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 0x7f2b98163360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 -- 10.20.193.91:0/3288521726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 msgr2=0x7f2b98163360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b98062fd0 0x7f2b98163360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 -- 10.20.193.91:0/3288521726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b98159a80 msgr2=0x7f2b981638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b98159a80 0x7f2b981638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8828004290 con 0x7f88401131c0 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b975776c0 1 -- 10.20.193.91:0/3288521726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b84009590 con 0x7f2b98168c60 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.198+0000 7f2b965756c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b98159a80 0x7f2b981638a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f88280043f0 con 0x7f88401131c0 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 msgr2=0x7f9a4c060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 --2- 10.20.193.91:0/3182627426 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9a4c1131c0 0x7f9a4c060c40 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a3c005dc0 tx=0x7f9a3c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b975776c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b98168c60 0x7f2b98169100 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b88006ea0 tx=0x7f2b8800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f882800cdb0 con 0x7f88401131c0 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884005fd90 con 0x7f88401131c0 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a4bfff6c0 1 -- 10.20.193.91:0/3182627426 reap_dead start 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== osd.5 v2:10.20.193.154:6808/2892893681 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f46a40fdb20 con 0x7f46a40dcfc0 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88400601c0 con 0x7f88401131c0 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 shutdown_connections 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 >> 10.20.193.91:0/3182627426 conn(0x7f9a4c0ea8b0 msgr2=0x7f9a4c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f46ca5756c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46a40b55e0 0x7f46a40d5a90 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0005fd0 tx=0x7f46c0005d10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 shutdown_connections 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f9a267fc6c0 1 -- 10.20.193.91:0/3182627426 wait complete. 2026-02-13T01:25:25.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.200+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efeb80b5830 msgr2=0x7efeb80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.200+0000 7efee4c816c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7efeb80b5830 0x7efeb80d5ce0 secure :-1 s=READY pgs=158 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efed4005fd0 tx=0x7efed4009310 comp rx=0 tx=0).stop 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.200+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee00f52e0 msgr2=0x7efee00fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.200+0000 7efee4c816c0 1 --2- 10.20.193.91:0/2347050172 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7efee00f52e0 0x7efee00fa5b0 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efed000c9b0 tx=0x7efed000ce80 comp rx=0 tx=0).stop 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.200+0000 7efeded766c0 1 -- 10.20.193.91:0/2347050172 reap_dead start 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b88003c40 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2b88003da0 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b880081c0 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b98157940 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b98157dd0 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.199+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b98052a50 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.201+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2b88005860 con 0x7f2b98168c60 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.200+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8840052a50 con 0x7f88401131c0 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8828002750 con 0x7f88401131c0 2026-02-13T01:25:25.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b73fff6c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b6c0b5760 0x7f2b6c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f881ffff6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f88140b5760 0x7f88140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f883effd6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f88140b5760 0x7f88140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f88280e3af0 con 0x7f88401131c0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f881ffff6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] conn(0x7f88140dd2b0 0x7f88140fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88140fde10 con 0x7f88140dd2b0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f88280e6170 con 0x7f88401131c0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f883effd6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f88140b5760 0x7f88140d5c10 secure :-1 s=READY pgs=165 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88340098c0 tx=0x7f88340023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f883f7fe6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] conn(0x7f88140dd2b0 0x7f88140fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f2b880e4df0 con 0x7f2b98168c60 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b96d766c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b6c0b5760 0x7f2b6c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b73fff6c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] conn(0x7f2b6c0dd2b0 0x7f2b6c0fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 --> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b6c0fde10 con 0x7f2b6c0dd2b0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f2b880e51a0 con 0x7f2b98168c60 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b965756c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] conn(0x7f2b6c0dd2b0 0x7f2b6c0fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.202+0000 7f2b96d766c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b6c0b5760 0x7f2b6c0d5c10 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c004750 tx=0x7f2b8c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f2b965756c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] conn(0x7f2b6c0dd2b0 0x7f2b6c0fd740 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== osd.9 v2:10.20.193.91:6826/1541303371 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f2b6c0fde10 con 0x7f2b6c0dd2b0 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.203+0000 7f883f7fe6c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] conn(0x7f88140dd2b0 0x7f88140fd740 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.204+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== osd.0 v2:10.20.193.91:6802/170892896 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f88140fde10 con 0x7f88140dd2b0 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.205+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 shutdown_connections 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.205+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 >> 10.20.193.91:0/2347050172 conn(0x7efee00ecb30 msgr2=0x7efee010d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.205+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 shutdown_connections 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.205+0000 7efee4c816c0 1 -- 10.20.193.91:0/2347050172 wait complete. 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.206+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 --> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcf4002d20 con 0x7fdd080dd230 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.206+0000 7fdd297fa6c0 1 -- 10.20.193.91:0/1471033338 <== osd.8 v2:10.20.193.154:6816/1364755569 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdcf4002d20 con 0x7fdd080dd230 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] conn(0x7fdd080dd230 msgr2=0x7fdd080fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.154:6816/1364755569,v1:10.20.193.154:6817/1364755569] conn(0x7fdd080dd230 0x7fdd080fd6c0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fdd080b56e0 msgr2=0x7fdd080d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fdd080b56e0 0x7fdd080d5b90 secure :-1 s=READY pgs=162 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd2c0fb4c0 tx=0x7fdd14006ce0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c10f230 msgr2=0x7fdd2c0f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 --2- 10.20.193.91:0/1471033338 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fdd2c10f230 0x7fdd2c0f4b30 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd1c00c800 tx=0x7fdd1c00ccd0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd30a416c0 1 -- 10.20.193.91:0/1471033338 reap_dead start 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 shutdown_connections 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 >> 10.20.193.91:0/1471033338 conn(0x7fdd2c0ecb30 msgr2=0x7fdd2c111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 shutdown_connections 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7fdd02ffd6c0 1 -- 10.20.193.91:0/1471033338 wait complete. 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 --> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46cc17d810 con 0x7f46a40dcfc0 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.208+0000 7f46b37fe6c0 1 -- 10.20.193.91:0/3182691237 <== osd.5 v2:10.20.193.154:6808/2892893681 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f46cc17d810 con 0x7f46a40dcfc0 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] conn(0x7f46a40dcfc0 msgr2=0x7f46a40fd450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.154:6808/2892893681,v1:10.20.193.154:6809/2892893681] conn(0x7f46a40dcfc0 0x7f46a40fd450 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46a40b55e0 msgr2=0x7f46a40d5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f46a40b55e0 0x7f46a40d5a90 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c0005fd0 tx=0x7f46c0005d10 comp rx=0 tx=0).stop 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 msgr2=0x7f46cc1636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 --2- 10.20.193.91:0/3182691237 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f46cc159a80 0x7f46cc1636c0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46b400b750 tx=0x7f46b400bc20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46cad766c0 1 -- 10.20.193.91:0/3182691237 reap_dead start 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 shutdown_connections 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 >> 10.20.193.91:0/3182691237 conn(0x7f46cc0ecb30 msgr2=0x7f46cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 shutdown_connections 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.210+0000 7f46d0ba86c0 1 -- 10.20.193.91:0/3182691237 wait complete. 2026-02-13T01:25:25.247 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.214+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 --> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8840177160 con 0x7f88140dd2b0 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f881ffff6c0 1 -- 10.20.193.91:0/29711936 <== osd.0 v2:10.20.193.91:6802/170892896 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8840177160 con 0x7f88140dd2b0 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] conn(0x7f88140dd2b0 msgr2=0x7f88140fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f88456486c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6802/170892896,v1:10.20.193.91:6803/170892896] conn(0x7f88140dd2b0 0x7f88140fd740 crc :-1 s=READY pgs=7 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f88140b5760 msgr2=0x7f88140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f88456486c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f88140b5760 0x7f88140d5c10 secure :-1 s=READY pgs=165 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88340098c0 tx=0x7f88340023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f88401131c0 msgr2=0x7f884011b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f88456486c0 1 --2- 10.20.193.91:0/29711936 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f88401131c0 0x7f884011b600 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8828006f30 tx=0x7f882800bbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f883f7fe6c0 1 -- 10.20.193.91:0/29711936 reap_dead start 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.215+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 --> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b9817d800 con 0x7f2b6c0dd2b0 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 shutdown_connections 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 >> 10.20.193.91:0/29711936 conn(0x7f8840065870 msgr2=0x7f8840111a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 shutdown_connections 2026-02-13T01:25:25.248 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f88456486c0 1 -- 10.20.193.91:0/29711936 wait complete. 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b73fff6c0 1 -- 10.20.193.91:0/3288521726 <== osd.9 v2:10.20.193.91:6826/1541303371 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2b9817d800 con 0x7f2b6c0dd2b0 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] conn(0x7f2b6c0dd2b0 msgr2=0x7f2b6c0fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6826/1541303371,v1:10.20.193.91:6827/1541303371] conn(0x7f2b6c0dd2b0 0x7f2b6c0fd740 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b6c0b5760 msgr2=0x7f2b6c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b6c0b5760 0x7f2b6c0d5c10 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c004750 tx=0x7f2b8c009260 comp rx=0 tx=0).stop 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b98168c60 msgr2=0x7f2b98169100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 --2- 10.20.193.91:0/3288521726 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b98168c60 0x7f2b98169100 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b88006ea0 tx=0x7f2b8800ce50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b975776c0 1 -- 10.20.193.91:0/3288521726 reap_dead start 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 shutdown_connections 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.216+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 >> 10.20.193.91:0/3288521726 conn(0x7f2b980ecb30 msgr2=0x7f2b9810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.217+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 shutdown_connections 2026-02-13T01:25:25.249 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.217+0000 7f2b9d1c46c0 1 -- 10.20.193.91:0/3288521726 wait complete. 2026-02-13T01:25:25.256 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- 10.20.193.91:0/3497204865 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a010cfb0 msgr2=0x7f76a010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.256 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3497204865 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a010cfb0 0x7f76a010d380 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=3722485072294849581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76900099a0 tx=0x7f769002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.256 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- 10.20.193.91:0/3497204865 shutdown_connections 2026-02-13T01:25:25.256 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3497204865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76a01131c0 0x7f76a0173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.256 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3497204865 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76a010d9a0 0x7f76a01129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.257 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3497204865 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a010cfb0 0x7f76a010d380 unknown :-1 s=CLOSED pgs=270 gs=1 cs=0 l=1 c_cookie=3722485072294849581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.257 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- 10.20.193.91:0/3497204865 >> 10.20.193.91:0/3497204865 conn(0x7f76a00ea8b0 msgr2=0x7f76a010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.257 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- 10.20.193.91:0/3497204865 shutdown_connections 2026-02-13T01:25:25.257 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- 10.20.193.91:0/3497204865 wait complete. 2026-02-13T01:25:25.257 INFO:teuthology.orchestra.run.trial091.stdout:68719476758 2026-02-13T01:25:25.257 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 Processor -- start 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- start start 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76a010cfb0 0x7f76a011b020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a01131c0 0x7f76a011b560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76a0120920 0x7f76a0120dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0121330 con 0x7f76a01131c0 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f76a01214a0 con 0x7f76a0120920 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.256+0000 7f76a73186c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0121660 con 0x7f76a010cfb0 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a01131c0 0x7f76a011b560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a01131c0 0x7f76a011b560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36978/0 (socket says 10.20.193.91:36978) 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 -- 10.20.193.91:0/3673652028 learned_addr learned my addr 10.20.193.91:0/3673652028 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a588e6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76a0120920 0x7f76a0120dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a508d6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76a010cfb0 0x7f76a011b020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.258 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 -- 10.20.193.91:0/3673652028 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76a010cfb0 msgr2=0x7f76a011b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76a010cfb0 0x7f76a011b020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 -- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76a0120920 msgr2=0x7f76a0120dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76a0120920 0x7f76a0120dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 -- 10.20.193.91:0/3673652028 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7690009590 con 0x7f76a01131c0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a588e6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76a0120920 0x7f76a0120dc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a488c6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a01131c0 0x7f76a011b560 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f769400b6c0 tx=0x7f769400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76940044a0 con 0x7f76a01131c0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a0161b10 con 0x7f76a01131c0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f769400be90 con 0x7f76a01131c0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f769400cad0 con 0x7f76a01131c0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a0161ff0 con 0x7f76a01131c0 2026-02-13T01:25:25.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.257+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76a0052a50 con 0x7f76a01131c0 2026-02-13T01:25:25.260 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.259+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f769400cca0 con 0x7f76a01131c0 2026-02-13T01:25:25.260 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f768e7fc6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f767c0b56e0 0x7f767c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.260 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f76a508d6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f767c0b56e0 0x7f767c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.260 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f76940e3b70 con 0x7f76a01131c0 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f768e7fc6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] conn(0x7f767c0dd230 0x7f767c0fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 --> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f767c0fdd90 con 0x7f767c0dd230 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f76940e3f90 con 0x7f76a01131c0 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.260+0000 7f76a588e6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] conn(0x7f767c0dd230 0x7f767c0fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.261+0000 7f76a508d6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f767c0b56e0 0x7f767c0d5b90 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76900023e0 tx=0x7f7690005de0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.261+0000 7f76a588e6c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] conn(0x7f767c0dd230 0x7f767c0fd6c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.261+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== osd.1 v2:10.20.193.126:6800/1754332231 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f767c0fdd90 con 0x7f767c0dd230 2026-02-13T01:25:25.262 INFO:teuthology.orchestra.run.trial091.stdout:128849018899 2026-02-13T01:25:25.262 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T01:25:25.262 INFO:teuthology.orchestra.run.trial091.stdout:270582939657 2026-02-13T01:25:25.262 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T01:25:25.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 --> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76a01770a0 con 0x7f767c0dd230 2026-02-13T01:25:25.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f768e7fc6c0 1 -- 10.20.193.91:0/3673652028 <== osd.1 v2:10.20.193.126:6800/1754332231 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f76a01770a0 con 0x7f767c0dd230 2026-02-13T01:25:25.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] conn(0x7f767c0dd230 msgr2=0x7f767c0fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.126:6800/1754332231,v1:10.20.193.126:6801/1754332231] conn(0x7f767c0dd230 0x7f767c0fd6c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f767c0b56e0 msgr2=0x7f767c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f767c0b56e0 0x7f767c0d5b90 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76900023e0 tx=0x7f7690005de0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a01131c0 msgr2=0x7f76a011b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 --2- 10.20.193.91:0/3673652028 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76a01131c0 0x7f76a011b560 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f769400b6c0 tx=0x7f769400bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:25.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a588e6c0 1 -- 10.20.193.91:0/3673652028 reap_dead start 2026-02-13T01:25:25.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 shutdown_connections 2026-02-13T01:25:25.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 >> 10.20.193.91:0/3673652028 conn(0x7f76a00ea8b0 msgr2=0x7f76a010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 shutdown_connections 2026-02-13T01:25:25.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.269+0000 7f76a73186c0 1 -- 10.20.193.91:0/3673652028 wait complete. 2026-02-13T01:25:25.271 INFO:teuthology.orchestra.run.trial091.stdout:300647710728 2026-02-13T01:25:25.271 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T01:25:25.274 INFO:teuthology.orchestra.run.trial091.stdout:223338299404 2026-02-13T01:25:25.275 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T01:25:25.280 INFO:teuthology.orchestra.run.trial091.stdout:176093659152 2026-02-13T01:25:25.280 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T01:25:25.312 INFO:teuthology.orchestra.run.trial091.stdout:34359738392 2026-02-13T01:25:25.312 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T01:25:25.325 INFO:teuthology.orchestra.run.trial091.stdout:51539607574 2026-02-13T01:25:25.326 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T01:25:25.332 INFO:teuthology.orchestra.run.trial091.stdout:98784247828 2026-02-13T01:25:25.333 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T01:25:25.333 INFO:teuthology.orchestra.run.trial091.stdout:146028888081 2026-02-13T01:25:25.334 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T01:25:25.335 INFO:teuthology.orchestra.run.trial091.stdout:253403070474 2026-02-13T01:25:25.336 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T01:25:25.368 INFO:teuthology.orchestra.run.trial091.stdout:193273528334 2026-02-13T01:25:25.368 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T01:25:25.385 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.396 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.397 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.408 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.410 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.413 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.469 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.503 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.504 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 -- 10.20.193.91:0/2711977990 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112fc0 msgr2=0x7f90c410b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/2711977990 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112fc0 0x7f90c410b730 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=5084591220707429339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90ac01ad80 tx=0x7f90ac040140 comp rx=0 tx=0).stop 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 -- 10.20.193.91:0/2711977990 shutdown_connections 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/2711977990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90c410c4e0 0x7f90c410c980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/2711977990 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112fc0 0x7f90c410b730 unknown :-1 s=CLOSED pgs=73 gs=2 cs=0 l=1 c_cookie=5084591220707429339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/2711977990 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112b10 0x7f90c410b1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 -- 10.20.193.91:0/2711977990 >> 10.20.193.91:0/2711977990 conn(0x7f90c4063af0 msgr2=0x7f90c40642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 -- 10.20.193.91:0/2711977990 shutdown_connections 2026-02-13T01:25:25.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.526+0000 7f90c8c976c0 1 -- 10.20.193.91:0/2711977990 wait complete. 2026-02-13T01:25:25.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 Processor -- start 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 -- start start 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90c410c4e0 0x7f90c41a3b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 0x7f90c41a4060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112fc0 0x7f90c41a9420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a9ac0 con 0x7f90c4112fc0 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a9c30 con 0x7f90c410c4e0 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c8c976c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f90c41a9df0 con 0x7f90c4112b10 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c25756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90c410c4e0 0x7f90c41a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 0x7f90c41a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 0x7f90c41a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51692/0 (socket says 10.20.193.91:51692) 2026-02-13T01:25:25.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 -- 10.20.193.91:0/3930117227 learned_addr learned my addr 10.20.193.91:0/3930117227 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c2d766c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112fc0 0x7f90c41a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 -- 10.20.193.91:0/3930117227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90c410c4e0 msgr2=0x7f90c41a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90c410c4e0 0x7f90c41a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 -- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112fc0 msgr2=0x7f90c41a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112fc0 0x7f90c41a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c1d746c0 1 -- 10.20.193.91:0/3930117227 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b400a5b0 con 0x7f90c4112b10 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.527+0000 7f90c2d766c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112fc0 0x7f90c41a9420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f90c1d746c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 0x7f90c41a4060 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90ac002fd0 tx=0x7f90ac005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90ac004400 con 0x7f90c4112b10 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f90ac004560 con 0x7f90c4112b10 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac01a9a0 con 0x7f90c4112b10 2026-02-13T01:25:25.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90ac0496c0 con 0x7f90c4112b10 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c420a5a0 con 0x7f90c4112b10 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/1706887429 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a5411a1e0 msgr2=0x7f3a5417ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/1706887429 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a5411a1e0 0x7f3a5417ab80 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=5077525604911550809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4c00bbc0 tx=0x7f3a4c030f30 comp rx=0 tx=0).stop 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/1706887429 shutdown_connections 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/1706887429 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a5411a1e0 0x7f3a5417ab80 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=5077525604911550809 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/1706887429 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a541152a0 0x7f3a54119a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/1706887429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a541148b0 0x7f3a54114c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/1706887429 >> 10.20.193.91:0/1706887429 conn(0x7f3a540586e0 msgr2=0x7f3a54058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.528+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/1706887429 shutdown_connections 2026-02-13T01:25:25.533 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.533 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/1706887429 wait complete. 2026-02-13T01:25:25.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 Processor -- start 2026-02-13T01:25:25.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c4065120 con 0x7f90c4112b10 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 -- start start 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a541148b0 0x7f3a5411e8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a5411a1e0 0x7f3a5411edf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 0x7f3a54124650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54124bc0 con 0x7f3a541241b0 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54124d30 con 0x7f3a5411a1e0 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a59fdc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54124ef0 con 0x7f3a541148b0 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a53fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 0x7f3a54124650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a53fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 0x7f3a54124650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37000/0 (socket says 10.20.193.91:37000) 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a53fff6c0 1 -- 10.20.193.91:0/3115912121 learned_addr learned my addr 10.20.193.91:0/3115912121 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.529+0000 7f3a537fe6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a541148b0 0x7f3a5411e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a52ffd6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a5411a1e0 0x7f3a5411edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a53fff6c0 1 -- 10.20.193.91:0/3115912121 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a541148b0 msgr2=0x7f3a5411e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a53fff6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a541148b0 0x7f3a5411e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a53fff6c0 1 -- 10.20.193.91:0/3115912121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a5411a1e0 msgr2=0x7f3a5411edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a53fff6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a5411a1e0 0x7f3a5411edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a53fff6c0 1 -- 10.20.193.91:0/3115912121 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c00b7b0 con 0x7f3a541241b0 2026-02-13T01:25:25.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f90ac0185d0 con 0x7f90c4112b10 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a53fff6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 0x7f3a54124650 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4c0027a0 tx=0x7f3a4c031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f74469436c0 1 -- 10.20.193.91:0/4258879821 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440115440 msgr2=0x7f7440175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f74469436c0 1 --2- 10.20.193.91:0/4258879821 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440115440 0x7f7440175de0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=17694836819454249186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743400aa70 tx=0x7f743402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f74469436c0 1 -- 10.20.193.91:0/4258879821 shutdown_connections 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f74469436c0 1 --2- 10.20.193.91:0/4258879821 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440115440 0x7f7440175de0 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=17694836819454249186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f74469436c0 1 --2- 10.20.193.91:0/4258879821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010fc20 0x7f7440114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f74469436c0 1 --2- 10.20.193.91:0/4258879821 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f744010f230 0x7f744010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f74469436c0 1 -- 10.20.193.91:0/4258879821 >> 10.20.193.91:0/4258879821 conn(0x7f74400ecb30 msgr2=0x7f744010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.530+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a4c0056b0 con 0x7f3a541241b0 2026-02-13T01:25:25.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a54176750 con 0x7f3a541241b0 2026-02-13T01:25:25.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a54176b80 con 0x7f3a541241b0 2026-02-13T01:25:25.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3a4c003ad0 con 0x7f3a541241b0 2026-02-13T01:25:25.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a4c033390 con 0x7f3a541241b0 2026-02-13T01:25:25.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f90ab7fe6c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f909c0b5760 0x7f909c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f90ac1191b0 con 0x7f90c4112b10 2026-02-13T01:25:25.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f90c25756c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f909c0b5760 0x7f909c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5405b020 con 0x7f3a541241b0 2026-02-13T01:25:25.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90ac0db9f0 con 0x7f90c4112b10 2026-02-13T01:25:25.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f90c25756c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f909c0b5760 0x7f909c0d5c10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90b8005980 tx=0x7f90b8009290 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.541 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:25.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3a4c008880 con 0x7f3a541241b0 2026-02-13T01:25:25.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.531+0000 7f74469436c0 1 -- 10.20.193.91:0/4258879821 shutdown_connections 2026-02-13T01:25:25.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f74469436c0 1 -- 10.20.193.91:0/4258879821 wait complete. 2026-02-13T01:25:25.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f74469436c0 1 Processor -- start 2026-02-13T01:25:25.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f74469436c0 1 -- start start 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f74469436c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010f230 0x7f7440103360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f74469436c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7440115440 0x7f74401038a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.532+0000 7f74469436c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 0x7f7440104260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f74469436c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f74401049f0 con 0x7f7440103de0 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f74469436c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7440104b60 con 0x7f744010f230 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f74469436c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7440104d20 con 0x7f7440115440 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f7444eb56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 0x7f7440104260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010f230 0x7f7440103360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f7444eb56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 0x7f7440104260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37006/0 (socket says 10.20.193.91:37006) 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f7444eb56c0 1 -- 10.20.193.91:0/2297409085 learned_addr learned my addr 10.20.193.91:0/2297409085 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743f7fe6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7440115440 0x7f74401038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 -- 10.20.193.91:0/2297409085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7440115440 msgr2=0x7f74401038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7440115440 0x7f74401038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 -- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 msgr2=0x7f7440104260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 0x7f7440104260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 -- 10.20.193.91:0/2297409085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743400a660 con 0x7f744010f230 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743ffff6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010f230 0x7f7440103360 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f742c00b440 tx=0x7f742c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f742c0044a0 con 0x7f744010f230 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.533+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7440105000 con 0x7f744010f230 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7440105530 con 0x7f744010f230 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f7444eb56c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 0x7f7440104260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f742c002b70 con 0x7f744010f230 2026-02-13T01:25:25.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f742c00cb40 con 0x7f744010f230 2026-02-13T01:25:25.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f3a50ff96c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3a280b57e0 0x7f3a280d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f3a537fe6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3a280b57e0 0x7f3a280d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.534+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f3a4c109000 con 0x7f3a541241b0 2026-02-13T01:25:25.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.535+0000 7f3a537fe6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3a280b57e0 0x7f3a280d5c90 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a44004750 tx=0x7f3a44009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.535+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7440110500 con 0x7f744010f230 2026-02-13T01:25:25.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.536+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3a4c0cb840 con 0x7f3a541241b0 2026-02-13T01:25:25.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.536+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f742c0026b0 con 0x7f744010f230 2026-02-13T01:25:25.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.536+0000 7f743d7fa6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74140b5760 0x7f74140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.537+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f742c0e39d0 con 0x7f744010f230 2026-02-13T01:25:25.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.537+0000 7f743f7fe6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74140b5760 0x7f74140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.537+0000 7f743f7fe6c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74140b5760 0x7f74140d5c10 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f744005e780 tx=0x7f7430009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.539+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f742c0a6210 con 0x7f744010f230 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/1543970272 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8159af0 msgr2=0x7f0cf8179ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/1543970272 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8159af0 0x7f0cf8179ed0 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=13382822594256287043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cec00aa40 tx=0x7f0cec02fe00 comp rx=0 tx=0).stop 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/1543970272 shutdown_connections 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/1543970272 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8159af0 0x7f0cf8179ed0 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=13382822594256287043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/1543970272 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf8060ce0 0x7f0cf8061110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/1543970272 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0cf80622d0 0x7f0cf80607a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.542+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/1543970272 >> 10.20.193.91:0/1543970272 conn(0x7f0cf80ea8b0 msgr2=0x7f0cf810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/1543970272 shutdown_connections 2026-02-13T01:25:25.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/1543970272 wait complete. 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 Processor -- start 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 -- start start 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 0x7f0cf80f2310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0cf80622d0 0x7f0cf80f2850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.543+0000 7f0cfe0296c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf8159af0 0x7f0cf80f7c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 0x7f0cf80f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 0x7f0cf80f2310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37036/0 (socket says 10.20.193.91:37036) 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 -- 10.20.193.91:0/120444795 learned_addr learned my addr 10.20.193.91:0/120444795 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80f8260 con 0x7f0cf8060ce0 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80f83d0 con 0x7f0cf8159af0 2026-02-13T01:25:25.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf80f8590 con 0x7f0cf80622d0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf6ffd6c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0cf80622d0 0x7f0cf80f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 -- 10.20.193.91:0/120444795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0cf80622d0 msgr2=0x7f0cf80f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0cf80622d0 0x7f0cf80f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 -- 10.20.193.91:0/120444795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf8159af0 msgr2=0x7f0cf80f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf8159af0 0x7f0cf80f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec00a660 con 0x7f0cf8060ce0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf77fe6c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 0x7f0cf80f2310 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce400b710 tx=0x7f0ce400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce4004250 con 0x7f0cf8060ce0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf80f8870 con 0x7f0cf8060ce0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0ce4009070 con 0x7f0cf8060ce0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.544+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ce400ccd0 con 0x7f0cf8060ce0 2026-02-13T01:25:25.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.545+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf80f8f30 con 0x7f0cf8060ce0 2026-02-13T01:25:25.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.545+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf8061cb0 con 0x7f0cf8060ce0 2026-02-13T01:25:25.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.546+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0ce40028c0 con 0x7f0cf8060ce0 2026-02-13T01:25:25.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.549+0000 7f0cf4ff96c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ccc0b56e0 0x7f0ccc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.549+0000 7f0cf6ffd6c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ccc0b56e0 0x7f0ccc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.549+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f0ce40e3e70 con 0x7f0cf8060ce0 2026-02-13T01:25:25.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0ce40a66b0 con 0x7f0cf8060ce0 2026-02-13T01:25:25.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f0cf6ffd6c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ccc0b56e0 0x7f0ccc0d5b90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cf80f8ca0 tx=0x7f0ce80094b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 -- 10.20.193.91:0/392980606 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9750115440 msgr2=0x7f9750175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 --2- 10.20.193.91:0/392980606 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9750115440 0x7f9750175de0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=11432695080926269555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f974c00a9b0 tx=0x7f974c02fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 -- 10.20.193.91:0/392980606 shutdown_connections 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 --2- 10.20.193.91:0/392980606 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9750115440 0x7f9750175de0 unknown :-1 s=CLOSED pgs=277 gs=2 cs=0 l=1 c_cookie=11432695080926269555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 --2- 10.20.193.91:0/392980606 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f975010fc20 0x7f9750114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 --2- 10.20.193.91:0/392980606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f975010f230 0x7f975010f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 -- 10.20.193.91:0/392980606 >> 10.20.193.91:0/392980606 conn(0x7f97500ecb30 msgr2=0x7f975010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 -- 10.20.193.91:0/392980606 shutdown_connections 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.550+0000 7f975730c6c0 1 -- 10.20.193.91:0/392980606 wait complete. 2026-02-13T01:25:25.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 Processor -- start 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 -- start start 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 0x7f975011d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9750115440 0x7f975011d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9750122b30 0x7f9750122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9750123540 con 0x7f975010f230 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f97501236b0 con 0x7f9750115440 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975730c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9750123870 con 0x7f9750122b30 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 0x7f975011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 0x7f975011d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37070/0 (socket says 10.20.193.91:37070) 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 -- 10.20.193.91:0/4035975350 learned_addr learned my addr 10.20.193.91:0/4035975350 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975487c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9750115440 0x7f975011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975587e6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9750122b30 0x7f9750122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 -- 10.20.193.91:0/4035975350 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9750122b30 msgr2=0x7f9750122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9750122b30 0x7f9750122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 -- 10.20.193.91:0/4035975350 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9750115440 msgr2=0x7f975011d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9750115440 0x7f975011d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 -- 10.20.193.91:0/4035975350 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c00a5b0 con 0x7f975010f230 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f975507d6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 0x7f975011d230 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f974000b800 tx=0x7f974000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.551+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9740004a80 con 0x7f975010f230 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.552+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9750163d20 con 0x7f975010f230 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.552+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9750164200 con 0x7f975010f230 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.552+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9740009030 con 0x7f975010f230 2026-02-13T01:25:25.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.552+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9750110500 con 0x7f975010f230 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- 10.20.193.91:0/833601323 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c115440 msgr2=0x7f721c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/833601323 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c115440 0x7f721c175de0 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=61196371217705319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721800aa70 tx=0x7f721802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- 10.20.193.91:0/833601323 shutdown_connections 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/833601323 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c115440 0x7f721c175de0 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=61196371217705319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/833601323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f721c10fc20 0x7f721c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/833601323 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f721c10f230 0x7f721c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- 10.20.193.91:0/833601323 >> 10.20.193.91:0/833601323 conn(0x7f721c0ecb30 msgr2=0x7f721c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- 10.20.193.91:0/833601323 shutdown_connections 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- 10.20.193.91:0/833601323 wait complete. 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 Processor -- start 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- start start 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 0x7f721c10cfd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f721c115440 0x7f721c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f721c10a290 0x7f721c10a730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f72208256c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 0x7f721c10cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f721c10ade0 con 0x7f721c10f230 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f721c10af50 con 0x7f721c10a290 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f72208256c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 0x7f721c10cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37086/0 (socket says 10.20.193.91:37086) 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f7222ab06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f721c10b110 con 0x7f721c115440 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.554+0000 7f72208256c0 1 -- 10.20.193.91:0/1581429129 learned_addr learned my addr 10.20.193.91:0/1581429129 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f7213fff6c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f721c115440 0x7f721c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72210266c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f721c10a290 0x7f721c10a730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f974000c9c0 con 0x7f975010f230 2026-02-13T01:25:25.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9740004be0 con 0x7f975010f230 2026-02-13T01:25:25.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72208256c0 1 -- 10.20.193.91:0/1581429129 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f721c115440 msgr2=0x7f721c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72208256c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f721c115440 0x7f721c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72208256c0 1 -- 10.20.193.91:0/1581429129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f721c10a290 msgr2=0x7f721c10a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72208256c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f721c10a290 0x7f721c10a730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72208256c0 1 -- 10.20.193.91:0/1581429129 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721800a660 con 0x7f721c10f230 2026-02-13T01:25:25.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f72208256c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 0x7f721c10cfd0 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f720c00b6f0 tx=0x7f720c00bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.555+0000 7f973e7fc6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f972c0b57a0 0x7f972c0d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.556+0000 7f975487c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f972c0b57a0 0x7f972c0d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.556+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f97400e3f10 con 0x7f975010f230 2026-02-13T01:25:25.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.556+0000 7f975487c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f972c0b57a0 0x7f972c0d5c50 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9750123bc0 tx=0x7f9744009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.557+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f720c004560 con 0x7f721c10f230 2026-02-13T01:25:25.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.558+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f720c009030 con 0x7f721c10f230 2026-02-13T01:25:25.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.558+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721c0f0050 con 0x7f721c10f230 2026-02-13T01:25:25.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.558+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f97400a6750 con 0x7f975010f230 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.558+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f720c00cdc0 con 0x7f721c10f230 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.558+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721c0f0580 con 0x7f721c10f230 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.559+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c110500 con 0x7f721c10f230 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.560+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f720c00c410 con 0x7f721c10f230 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.561+0000 7f7211ffb6c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f71f80b5760 0x7f71f80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.561+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f720c0e3b70 con 0x7f721c10f230 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.561+0000 7f7213fff6c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f71f80b5760 0x7f71f80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.561+0000 7f7213fff6c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f71f80b5760 0x7f71f80d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721c10cd40 tx=0x7f7204009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.564+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f720c0a63b0 con 0x7f721c10f230 2026-02-13T01:25:25.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 -- 10.20.193.91:0/2914664109 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e41131c0 msgr2=0x7f32e4173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 --2- 10.20.193.91:0/2914664109 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e41131c0 0x7f32e4173b60 secure :-1 s=READY pgs=281 gs=3 cs=0 l=1 c_cookie=12445917551950433077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d400aa70 tx=0x7f32d402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 -- 10.20.193.91:0/2914664109 shutdown_connections 2026-02-13T01:25:25.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 --2- 10.20.193.91:0/2914664109 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e41131c0 0x7f32e4173b60 unknown :-1 s=CLOSED pgs=281 gs=3 cs=0 l=1 c_cookie=12445917551950433077 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 --2- 10.20.193.91:0/2914664109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e410d9a0 0x7f32e41129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 --2- 10.20.193.91:0/2914664109 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e410cfb0 0x7f32e410d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 -- 10.20.193.91:0/2914664109 >> 10.20.193.91:0/2914664109 conn(0x7f32e40ea8b0 msgr2=0x7f32e410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 -- 10.20.193.91:0/2914664109 shutdown_connections 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.613+0000 7f32e90c46c0 1 -- 10.20.193.91:0/2914664109 wait complete. 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 Processor -- start 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 -- start start 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e410cfb0 0x7f32e40f4970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 0x7f32e4173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e40f4fa0 0x7f32e40fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40f5690 con 0x7f32e410cfb0 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40fa7b0 con 0x7f32e40f4fa0 2026-02-13T01:25:25.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.614+0000 7f32e90c46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40fa970 con 0x7f32e41131c0 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e35776c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e40f4fa0 0x7f32e40fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 0x7f32e4173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 0x7f32e4173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51786/0 (socket says 10.20.193.91:51786) 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 -- 10.20.193.91:0/3993430320 learned_addr learned my addr 10.20.193.91:0/3993430320 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e2d766c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e410cfb0 0x7f32e40f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 -- 10.20.193.91:0/3993430320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e40f4fa0 msgr2=0x7f32e40fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e40f4fa0 0x7f32e40fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 -- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e410cfb0 msgr2=0x7f32e40f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e410cfb0 0x7f32e40f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 -- 10.20.193.91:0/3993430320 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d400a660 con 0x7f32e41131c0 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e2d766c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e410cfb0 0x7f32e40f4970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32e25756c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 0x7f32e4173a60 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d000b800 tx=0x7f32d000bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d0004240 con 0x7f32e41131c0 2026-02-13T01:25:25.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.615+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f32d00043a0 con 0x7f32e41131c0 2026-02-13T01:25:25.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.616+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32d000ccd0 con 0x7f32e41131c0 2026-02-13T01:25:25.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.616+0000 7f32e90c46c0 1 -- 10.20.193.91:0/3993430320 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e40fac50 con 0x7f32e41131c0 2026-02-13T01:25:25.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.616+0000 7f32e90c46c0 1 -- 10.20.193.91:0/3993430320 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e40fb3e0 con 0x7f32e41131c0 2026-02-13T01:25:25.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.616+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e410e280 con 0x7f32e41131c0 2026-02-13T01:25:25.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.618+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f32d00026b0 con 0x7f32e41131c0 2026-02-13T01:25:25.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.619+0000 7f32bffff6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32b80b5660 0x7f32b80d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.619+0000 7f32e2d766c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32b80b5660 0x7f32b80d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.619+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f32d00e3ac0 con 0x7f32e41131c0 2026-02-13T01:25:25.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.619+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f32d011c5e0 con 0x7f32e41131c0 2026-02-13T01:25:25.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.620+0000 7f32e2d766c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32b80b5660 0x7f32b80d5b10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d8004750 tx=0x7f32d8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 -- 10.20.193.91:0/4214120205 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 msgr2=0x7f963c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4214120205 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 0x7f963c10f600 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=17628928544477332270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f962c0099a0 tx=0x7f962c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 -- 10.20.193.91:0/4214120205 shutdown_connections 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4214120205 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c115440 0x7f963c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4214120205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f963c10fc20 0x7f963c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4214120205 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 0x7f963c10f600 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=17628928544477332270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 -- 10.20.193.91:0/4214120205 >> 10.20.193.91:0/4214120205 conn(0x7f963c0ecb30 msgr2=0x7f963c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 -- 10.20.193.91:0/4214120205 shutdown_connections 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 -- 10.20.193.91:0/4214120205 wait complete. 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 Processor -- start 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 -- start start 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 0x7f963c11d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f963c115440 0x7f963c11d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.637+0000 7f964441b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 0x7f963c122fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964441b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f963c123550 con 0x7f963c122b40 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964441b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f963c1236c0 con 0x7f963c115440 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964441b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f963c123880 con 0x7f963c10f230 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 0x7f963c122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 0x7f963c122fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37124/0 (socket says 10.20.193.91:37124) 2026-02-13T01:25:25.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964218c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 0x7f963c11d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 -- 10.20.193.91:0/4152255499 learned_addr learned my addr 10.20.193.91:0/4152255499 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964198b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f963c115440 0x7f963c11d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 -- 10.20.193.91:0/4152255499 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 msgr2=0x7f963c11d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 0x7f963c11d240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 -- 10.20.193.91:0/4152255499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f963c115440 msgr2=0x7f963c11d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f963c115440 0x7f963c11d780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 -- 10.20.193.91:0/4152255499 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962c009590 con 0x7f963c122b40 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964298d6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 0x7f963c122fe0 secure :-1 s=READY pgs=282 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9638006ea0 tx=0x7f963800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9638003c40 con 0x7f963c122b40 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9638003da0 con 0x7f963c122b40 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c163d30 con 0x7f963c122b40 2026-02-13T01:25:25.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c164210 con 0x7f963c122b40 2026-02-13T01:25:25.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.638+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96380081c0 con 0x7f963c122b40 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.639+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c110500 con 0x7f963c122b40 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.641+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f963800d590 con 0x7f963c122b40 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.641+0000 7f96237fe6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96180b5660 0x7f96180d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.641+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f96380e4dc0 con 0x7f963c122b40 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.642+0000 7f964218c6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96180b5660 0x7f96180d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.642+0000 7f964218c6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96180b5660 0x7f96180d5b10 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f962c0023e0 tx=0x7f962c005de0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.642+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f96380a7640 con 0x7f963c122b40 2026-02-13T01:25:25.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.645+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f744005df90 con 0x7f744010f230 2026-02-13T01:25:25.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.646+0000 7f743d7fa6c0 1 -- 10.20.193.91:0/2297409085 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f742c0a93c0 con 0x7f744010f230 2026-02-13T01:25:25.646 INFO:teuthology.orchestra.run.trial091.stdout:68719476756 2026-02-13T01:25:25.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.647+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3a5411fa00 con 0x7f3a541241b0 2026-02-13T01:25:25.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f3a50ff96c0 1 -- 10.20.193.91:0/3115912121 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3a4c0ce9f0 con 0x7f3a541241b0 2026-02-13T01:25:25.648 INFO:teuthology.orchestra.run.trial091.stdout:128849018898 2026-02-13T01:25:25.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74140b5760 msgr2=0x7f74140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74140b5760 0x7f74140d5c10 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f744005e780 tx=0x7f7430009390 comp rx=0 tx=0).stop 2026-02-13T01:25:25.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010f230 msgr2=0x7f7440103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010f230 0x7f7440103360 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f742c00b440 tx=0x7f742c00b910 comp rx=0 tx=0).stop 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 shutdown_connections 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74140b5760 0x7f74140d5c10 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7440103de0 0x7f7440104260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7440115440 0x7f74401038a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 --2- 10.20.193.91:0/2297409085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f744010f230 0x7f7440103360 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 >> 10.20.193.91:0/2297409085 conn(0x7f74400ecb30 msgr2=0x7f7440110c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 shutdown_connections 2026-02-13T01:25:25.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f74469436c0 1 -- 10.20.193.91:0/2297409085 wait complete. 2026-02-13T01:25:25.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f2e3af346c0 1 -- 10.20.193.91:0/3900027007 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 msgr2=0x7f2e34175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/3900027007 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175db0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=9035547758100697763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e3000aa70 tx=0x7f2e3002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f2e3af346c0 1 -- 10.20.193.91:0/3900027007 shutdown_connections 2026-02-13T01:25:25.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/3900027007 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175db0 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=9035547758100697763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/3900027007 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e3410fbf0 0x7f2e34114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.648+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/3900027007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e3410f200 0x7f2e3410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.649+0000 7f2e3af346c0 1 -- 10.20.193.91:0/3900027007 >> 10.20.193.91:0/3900027007 conn(0x7f2e340ecb00 msgr2=0x7f2e3410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.649+0000 7f2e3af346c0 1 -- 10.20.193.91:0/3900027007 shutdown_connections 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.649+0000 7f2e3af346c0 1 -- 10.20.193.91:0/3900027007 wait complete. 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.649+0000 7f2e3af346c0 1 Processor -- start 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 -- start start 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e3410f200 0x7f2e340f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3a280b57e0 msgr2=0x7f3a280d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3a280b57e0 0x7f3a280d5c90 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a44004750 tx=0x7f3a44009390 comp rx=0 tx=0).stop 2026-02-13T01:25:25.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 msgr2=0x7f3a54124650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 0x7f3a54124650 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a4c0027a0 tx=0x7f3a4c031c70 comp rx=0 tx=0).stop 2026-02-13T01:25:25.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e340f51f0 0x7f2e340fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2e340f58e0 con 0x7f2e34115410 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e340faa00 con 0x7f2e3410f200 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e3af346c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e340fabc0 con 0x7f2e340f51f0 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e2bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e2bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37146/0 (socket says 10.20.193.91:37146) 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e2bfff6c0 1 -- 10.20.193.91:0/2340978053 learned_addr learned my addr 10.20.193.91:0/2340978053 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e340f51f0 0x7f2e340fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e38ca56c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e3410f200 0x7f2e340f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 -- 10.20.193.91:0/2340978053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e3410f200 msgr2=0x7f2e340f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e3410f200 0x7f2e340f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 -- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 msgr2=0x7f2e34175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 -- 10.20.193.91:0/2340978053 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3000a660 con 0x7f2e340f51f0 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e2bfff6c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e394a66c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e340f51f0 0x7f2e340fa4c0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e3000aa70 tx=0x7f2e300054b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.650+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e30003a30 con 0x7f2e340f51f0 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2e30003b90 con 0x7f2e340f51f0 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e340fae40 con 0x7f2e340f51f0 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e300372f0 con 0x7f2e340f51f0 2026-02-13T01:25:25.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e340fb270 con 0x7f2e340f51f0 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 shutdown_connections 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3a280b57e0 0x7f3a280d5c90 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a541241b0 0x7f3a54124650 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a5411a1e0 0x7f3a5411edf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 --2- 10.20.193.91:0/3115912121 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a541148b0 0x7f3a5411e8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 >> 10.20.193.91:0/3115912121 conn(0x7f3a540586e0 msgr2=0x7f3a54117810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 shutdown_connections 2026-02-13T01:25:25.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f3a59fdc6c0 1 -- 10.20.193.91:0/3115912121 wait complete. 2026-02-13T01:25:25.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f90c410c980 con 0x7f90c4112b10 2026-02-13T01:25:25.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f90ab7fe6c0 1 -- 10.20.193.91:0/3930117227 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f90ac0deba0 con 0x7f90c4112b10 2026-02-13T01:25:25.657 INFO:teuthology.orchestra.run.trial091.stdout:270582939656 2026-02-13T01:25:25.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.651+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e341104d0 con 0x7f2e340f51f0 2026-02-13T01:25:25.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.652+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2e30008260 con 0x7f2e340f51f0 2026-02-13T01:25:25.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f2e29ffb6c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2e100b56e0 0x7f2e100d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f2e38ca56c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2e100b56e0 0x7f2e100d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f2e30108ec0 con 0x7f2e340f51f0 2026-02-13T01:25:25.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f2e38ca56c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2e100b56e0 0x7f2e100d5b90 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e24004750 tx=0x7f2e24009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f909c0b5760 msgr2=0x7f909c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f909c0b5760 0x7f909c0d5c10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90b8005980 tx=0x7f90b8009290 comp rx=0 tx=0).stop 2026-02-13T01:25:25.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 msgr2=0x7f90c41a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 0x7f90c41a4060 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90ac002fd0 tx=0x7f90ac005fb0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2e300cb700 con 0x7f2e340f51f0 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 shutdown_connections 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f909c0b5760 0x7f909c0d5c10 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f90c4112fc0 0x7f90c41a9420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f90c4112b10 0x7f90c41a4060 unknown :-1 s=CLOSED pgs=74 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 --2- 10.20.193.91:0/3930117227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90c410c4e0 0x7f90c41a3b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 >> 10.20.193.91:0/3930117227 conn(0x7f90c4063af0 msgr2=0x7f90c41117f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 shutdown_connections 2026-02-13T01:25:25.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.653+0000 7f90c8c976c0 1 -- 10.20.193.91:0/3930117227 wait complete. 2026-02-13T01:25:25.661 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:25 trial091 ceph-mon[25068]: pgmap v184: 97 pgs: 97 active+clean; 636 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 15 KiB/s wr, 34 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:25:25.661 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:25 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2029686119' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.659+0000 7f43659b36c0 1 -- 10.20.193.91:0/4203127161 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4360115440 msgr2=0x7f4360175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.659+0000 7f43659b36c0 1 --2- 10.20.193.91:0/4203127161 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4360115440 0x7f4360175de0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=15681400221813246885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f435000aa70 tx=0x7f435002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.659+0000 7f43659b36c0 1 -- 10.20.193.91:0/4203127161 shutdown_connections 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 --2- 10.20.193.91:0/4203127161 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4360115440 0x7f4360175de0 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=15681400221813246885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 --2- 10.20.193.91:0/4203127161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f436010fc20 0x7f4360114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 --2- 10.20.193.91:0/4203127161 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f436010f230 0x7f436010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- 10.20.193.91:0/4203127161 >> 10.20.193.91:0/4203127161 conn(0x7f43600ecb30 msgr2=0x7f436010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- 10.20.193.91:0/4203127161 shutdown_connections 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- 10.20.193.91:0/4203127161 wait complete. 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 Processor -- start 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- start start 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 0x7f436011d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4360115440 0x7f436011d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4360122b30 0x7f4360122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4360123540 con 0x7f436010f230 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f43601236b0 con 0x7f4360115440 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f43659b36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4360123870 con 0x7f4360122b30 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 0x7f436011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 0x7f436011d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37174/0 (socket says 10.20.193.91:37174) 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 -- 10.20.193.91:0/3488404959 learned_addr learned my addr 10.20.193.91:0/3488404959 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435e7fc6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4360115440 0x7f436011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435f7fe6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4360122b30 0x7f4360122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 -- 10.20.193.91:0/3488404959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4360122b30 msgr2=0x7f4360122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4360122b30 0x7f4360122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 -- 10.20.193.91:0/3488404959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4360115440 msgr2=0x7f436011d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4360115440 0x7f436011d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435effd6c0 1 -- 10.20.193.91:0/3488404959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435000a660 con 0x7f436010f230 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.660+0000 7f435f7fe6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4360122b30 0x7f4360122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.661+0000 7f435effd6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 0x7f436011d230 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4354005dc0 tx=0x7f435400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.661+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4354004250 con 0x7f436010f230 2026-02-13T01:25:25.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.661+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4360163d20 con 0x7f436010f230 2026-02-13T01:25:25.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.661+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43601641b0 con 0x7f436010f230 2026-02-13T01:25:25.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.661+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4360110500 con 0x7f436010f230 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/2575422556 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d241131c0 msgr2=0x7f1d24173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/2575422556 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d241131c0 0x7f1d24173b60 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=5540135294879121039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d1800aa70 tx=0x7f1d1802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/2575422556 shutdown_connections 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/2575422556 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d241131c0 0x7f1d24173b60 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=5540135294879121039 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/2575422556 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d2410d9a0 0x7f1d241129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/2575422556 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d2410cfb0 0x7f1d2410d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/2575422556 >> 10.20.193.91:0/2575422556 conn(0x7f1d240ea8b0 msgr2=0x7f1d2410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/2575422556 shutdown_connections 2026-02-13T01:25:25.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.662+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/2575422556 wait complete. 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 Processor -- start 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 -- start start 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d2410cfb0 0x7f1d24060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d241131c0 0x7f1d24060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d24061180 0x7f1d241632a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1d241637e0 con 0x7f1d24061180 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1d24163950 con 0x7f1d2410cfb0 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d2a1096c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d24163b10 con 0x7f1d241131c0 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d23fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d24061180 0x7f1d241632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d23fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d24061180 0x7f1d241632a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37192/0 (socket says 10.20.193.91:37192) 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d23fff6c0 1 -- 10.20.193.91:0/3561994167 learned_addr learned my addr 10.20.193.91:0/3561994167 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d22ffd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d241131c0 0x7f1d24060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d237fe6c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d2410cfb0 0x7f1d24060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d22ffd6c0 1 -- 10.20.193.91:0/3561994167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d2410cfb0 msgr2=0x7f1d24060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d22ffd6c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d2410cfb0 0x7f1d24060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d22ffd6c0 1 -- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d24061180 msgr2=0x7f1d241632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d22ffd6c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d24061180 0x7f1d241632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.663+0000 7f1d22ffd6c0 1 -- 10.20.193.91:0/3561994167 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d140094c0 con 0x7f1d241131c0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d22ffd6c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d241131c0 0x7f1d24060c40 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d14004750 tx=0x7f1d1400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d140044a0 con 0x7f1d241131c0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1d14009030 con 0x7f1d241131c0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d1400ce50 con 0x7f1d241131c0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1800a660 con 0x7f1d241131c0 2026-02-13T01:25:25.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d241640f0 con 0x7f1d241131c0 2026-02-13T01:25:25.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4354009070 con 0x7f436010f230 2026-02-13T01:25:25.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f435400cd70 con 0x7f436010f230 2026-02-13T01:25:25.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f43540071c0 con 0x7f436010f230 2026-02-13T01:25:25.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.664+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2410e280 con 0x7f1d241131c0 2026-02-13T01:25:25.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.665+0000 7f43649ad6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f43340b5820 0x7f43340d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.665+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f43540e4dc0 con 0x7f436010f230 2026-02-13T01:25:25.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.665+0000 7f435e7fc6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f43340b5820 0x7f43340d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.666+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f43540e5170 con 0x7f436010f230 2026-02-13T01:25:25.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.666+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f1d14004880 con 0x7f1d241131c0 2026-02-13T01:25:25.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.666+0000 7f435e7fc6c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f43340b5820 0x7f43340d5cd0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4360123bc0 tx=0x7f4348009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.666+0000 7f1d20ff96c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1cf80b57e0 0x7f1cf80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.667+0000 7f1d237fe6c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1cf80b57e0 0x7f1cf80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.667+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f1d140e3c70 con 0x7f1d241131c0 2026-02-13T01:25:25.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.667+0000 7f1d237fe6c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1cf80b57e0 0x7f1cf80d5c90 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d10004750 tx=0x7f1d10009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.667+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1d140a6540 con 0x7f1d241131c0 2026-02-13T01:25:25.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.668+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f0cf80f3490 con 0x7f0cf8060ce0 2026-02-13T01:25:25.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.668+0000 7f0cf4ff96c0 1 -- 10.20.193.91:0/120444795 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0ce400ce60 con 0x7f0cf8060ce0 2026-02-13T01:25:25.674 INFO:teuthology.orchestra.run.trial091.stdout:300647710727 2026-02-13T01:25:25.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.668+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f975010fc20 con 0x7f975010f230 2026-02-13T01:25:25.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.669+0000 7f973e7fc6c0 1 -- 10.20.193.91:0/4035975350 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f97400a9900 con 0x7f975010f230 2026-02-13T01:25:25.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 -- 10.20.193.91:0/3306066471 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f410be70 msgr2=0x7ff9f410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/3306066471 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f410be70 0x7ff9f410c240 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=14302484831433868312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9e40099a0 tx=0x7ff9e402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 -- 10.20.193.91:0/3306066471 shutdown_connections 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/3306066471 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f4112080 0x7ff9f4172a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/3306066471 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410c860 0x7ff9f41118a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/3306066471 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f410be70 0x7ff9f410c240 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=14302484831433868312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 -- 10.20.193.91:0/3306066471 >> 10.20.193.91:0/3306066471 conn(0x7ff9f40e9770 msgr2=0x7ff9f4109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7ff9fae146c0 1 -- 10.20.193.91:0/3306066471 shutdown_connections 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stdout:176093659151 2026-02-13T01:25:25.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7ff9fae146c0 1 -- 10.20.193.91:0/3306066471 wait complete. 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ccc0b56e0 msgr2=0x7f0ccc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ccc0b56e0 0x7f0ccc0d5b90 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0cf80f8ca0 tx=0x7f0ce80094b0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 msgr2=0x7f0cf80f2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.671+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 0x7f0cf80f2310 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ce400b710 tx=0x7f0ce400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f972c0b57a0 msgr2=0x7f972c0d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f972c0b57a0 0x7f972c0d5c50 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9750123bc0 tx=0x7f9744009260 comp rx=0 tx=0).stop 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 msgr2=0x7f975011d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 0x7f975011d230 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f974000b800 tx=0x7f974000bcd0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 shutdown_connections 2026-02-13T01:25:25.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 shutdown_connections 2026-02-13T01:25:25.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f972c0b57a0 0x7f972c0d5c50 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9750122b30 0x7f9750122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9750115440 0x7f975011d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0ccc0b56e0 0x7f0ccc0d5b90 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf8159af0 0x7f0cf80f7c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0cf80622d0 0x7f0cf80f2850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 --2- 10.20.193.91:0/120444795 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0cf8060ce0 0x7f0cf80f2310 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 >> 10.20.193.91:0/120444795 conn(0x7f0cf80ea8b0 msgr2=0x7f0cf810dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 --2- 10.20.193.91:0/4035975350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f975010f230 0x7f975011d230 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 >> 10.20.193.91:0/4035975350 conn(0x7f97500ecb30 msgr2=0x7f975010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 shutdown_connections 2026-02-13T01:25:25.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 shutdown_connections 2026-02-13T01:25:25.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f0cfe0296c0 1 -- 10.20.193.91:0/120444795 wait complete. 2026-02-13T01:25:25.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7f975730c6c0 1 -- 10.20.193.91:0/4035975350 wait complete. 2026-02-13T01:25:25.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7ff9fae146c0 1 Processor -- start 2026-02-13T01:25:25.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.672+0000 7ff9fae146c0 1 -- start start 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9fae146c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 0x7ff9f40f2a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9fae146c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f4112080 0x7ff9f4172920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9fae146c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f40f30b0 0x7ff9f40f8330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9fae146c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40f37a0 con 0x7ff9f4112080 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9fae146c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40f8870 con 0x7ff9f410be70 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9ebfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f4112080 0x7ff9f4172920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 0x7ff9f40f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 0x7ff9f40f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:52686/0 (socket says 10.20.193.91:52686) 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 -- 10.20.193.91:0/1993866245 learned_addr learned my addr 10.20.193.91:0/1993866245 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40f8a30 con 0x7ff9f40f30b0 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f93866c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f40f30b0 0x7ff9f40f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 -- 10.20.193.91:0/1993866245 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f40f30b0 msgr2=0x7ff9f40f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f40f30b0 0x7ff9f40f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 -- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f4112080 msgr2=0x7ff9f4172920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f4112080 0x7ff9f4172920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f8b856c0 1 -- 10.20.193.91:0/1993866245 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e4009590 con 0x7ff9f410be70 2026-02-13T01:25:25.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9f93866c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f40f30b0 0x7ff9f40f8330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.673+0000 7ff9ebfff6c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f4112080 0x7ff9f4172920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7ff9f8b856c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 0x7ff9f40f2a80 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9e4009290 tx=0x7ff9e4005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9e4002ba0 con 0x7ff9f410be70 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f40f8cb0 con 0x7ff9f410be70 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff9e4002d00 con 0x7ff9f410be70 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9e40076b0 con 0x7ff9f410be70 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f40f9180 con 0x7ff9f410be70 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f721c10f630 con 0x7f721c10f230 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.674+0000 7f7211ffb6c0 1 -- 10.20.193.91:0/1581429129 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f720c0026b0 con 0x7f721c10f230 2026-02-13T01:25:25.683 INFO:teuthology.orchestra.run.trial091.stdout:223338299403 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.675+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff9e4038550 con 0x7ff9f410be70 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.675+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f410d140 con 0x7ff9f410be70 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.676+0000 7ff9e9ffb6c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9d00b5760 0x7ff9d00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.676+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff9e410c380 con 0x7ff9f410be70 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.676+0000 7ff9ebfff6c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9d00b5760 0x7ff9d00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.676+0000 7ff9ebfff6c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9d00b5760 0x7ff9d00d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9f40f93c0 tx=0x7ff9dc0093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff9e40cebc0 con 0x7ff9f410be70 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f71f80b5760 msgr2=0x7f71f80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f71f80b5760 0x7f71f80d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721c10cd40 tx=0x7f7204009310 comp rx=0 tx=0).stop 2026-02-13T01:25:25.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 msgr2=0x7f721c10cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 0x7f721c10cfd0 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f720c00b6f0 tx=0x7f720c00bbc0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 shutdown_connections 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f71f80b5760 0x7f71f80d5c10 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f721c10a290 0x7f721c10a730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f721c115440 0x7f721c175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 --2- 10.20.193.91:0/1581429129 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f721c10f230 0x7f721c10cfd0 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 >> 10.20.193.91:0/1581429129 conn(0x7f721c0ecb30 msgr2=0x7f721c10d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 shutdown_connections 2026-02-13T01:25:25.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.678+0000 7f7222ab06c0 1 -- 10.20.193.91:0/1581429129 wait complete. 2026-02-13T01:25:25.713 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476758 got 68719476756 for osd.2 2026-02-13T01:25:25.714 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018899 got 128849018898 for osd.4 2026-02-13T01:25:25.722 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939657 got 270582939656 for osd.10 2026-02-13T01:25:25.733 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710728 got 300647710727 for osd.11 2026-02-13T01:25:25.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659152 got 176093659151 for osd.6 2026-02-13T01:25:25.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.734+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f32e40faab0 con 0x7f32e41131c0 2026-02-13T01:25:25.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.734+0000 7f32bffff6c0 1 -- 10.20.193.91:0/3993430320 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32e40faab0 con 0x7f32e41131c0 2026-02-13T01:25:25.735 INFO:teuthology.orchestra.run.trial091.stdout:34359738391 2026-02-13T01:25:25.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32b80b5660 msgr2=0x7f32b80d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32b80b5660 0x7f32b80d5b10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d8004750 tx=0x7f32d8009260 comp rx=0 tx=0).stop 2026-02-13T01:25:25.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 msgr2=0x7f32e4173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 0x7f32e4173a60 secure :-1 s=READY pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d000b800 tx=0x7f32d000bcd0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 shutdown_connections 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f32b80b5660 0x7f32b80d5b10 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e40f4fa0 0x7f32e40fa270 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f32e41131c0 0x7f32e4173a60 unknown :-1 s=CLOSED pgs=75 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 --2- 10.20.193.91:0/3993430320 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f32e410cfb0 0x7f32e40f4970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 >> 10.20.193.91:0/3993430320 conn(0x7f32e40ea8b0 msgr2=0x7f32e410e770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 shutdown_connections 2026-02-13T01:25:25.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.737+0000 7f32bdffb6c0 1 -- 10.20.193.91:0/3993430320 wait complete. 2026-02-13T01:25:25.742 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299404 got 223338299403 for osd.8 2026-02-13T01:25:25.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.766+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2e3410f5d0 con 0x7f2e340f51f0 2026-02-13T01:25:25.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.767+0000 7f2e29ffb6c0 1 -- 10.20.193.91:0/2340978053 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e300ce8b0 con 0x7f2e340f51f0 2026-02-13T01:25:25.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.767+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f963c10f660 con 0x7f963c122b40 2026-02-13T01:25:25.767 INFO:teuthology.orchestra.run.trial091.stdout:98784247827 2026-02-13T01:25:25.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.767+0000 7f96237fe6c0 1 -- 10.20.193.91:0/4152255499 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96380aa7f0 con 0x7f963c122b40 2026-02-13T01:25:25.768 INFO:teuthology.orchestra.run.trial091.stdout:51539607573 2026-02-13T01:25:25.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2e100b56e0 msgr2=0x7f2e100d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2e100b56e0 0x7f2e100d5b90 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e24004750 tx=0x7f2e24009260 comp rx=0 tx=0).stop 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e340f51f0 msgr2=0x7f2e340fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e340f51f0 0x7f2e340fa4c0 secure :-1 s=READY pgs=77 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e3000aa70 tx=0x7f2e300054b0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 shutdown_connections 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2e100b56e0 0x7f2e100d5b90 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2e340f51f0 0x7f2e340fa4c0 unknown :-1 s=CLOSED pgs=77 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2e34115410 0x7f2e34175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 --2- 10.20.193.91:0/2340978053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e3410f200 0x7f2e340f4bc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 >> 10.20.193.91:0/2340978053 conn(0x7f2e340ecb00 msgr2=0x7f2e34113b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 shutdown_connections 2026-02-13T01:25:25.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.769+0000 7f2e3af346c0 1 -- 10.20.193.91:0/2340978053 wait complete. 2026-02-13T01:25:25.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96180b5660 msgr2=0x7f96180d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96180b5660 0x7f96180d5b10 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f962c0023e0 tx=0x7f962c005de0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 msgr2=0x7f963c122fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 0x7f963c122fe0 secure :-1 s=READY pgs=282 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9638006ea0 tx=0x7f963800ce50 comp rx=0 tx=0).stop 2026-02-13T01:25:25.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 shutdown_connections 2026-02-13T01:25:25.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96180b5660 0x7f96180d5b10 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f963c122b40 0x7f963c122fe0 unknown :-1 s=CLOSED pgs=282 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f963c115440 0x7f963c11d780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 --2- 10.20.193.91:0/4152255499 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f963c10f230 0x7f963c11d240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 >> 10.20.193.91:0/4152255499 conn(0x7f963c0ecb30 msgr2=0x7f963c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 shutdown_connections 2026-02-13T01:25:25.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.770+0000 7f964441b6c0 1 -- 10.20.193.91:0/4152255499 wait complete. 2026-02-13T01:25:25.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.776+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f436010f600 con 0x7f436010f230 2026-02-13T01:25:25.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.776+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1d24061a00 con 0x7f1d241131c0 2026-02-13T01:25:25.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.776+0000 7f1d20ff96c0 1 -- 10.20.193.91:0/3561994167 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1d140a9660 con 0x7f1d241131c0 2026-02-13T01:25:25.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.776+0000 7f43649ad6c0 1 -- 10.20.193.91:0/3488404959 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f43540a7600 con 0x7f436010f230 2026-02-13T01:25:25.777 INFO:teuthology.orchestra.run.trial091.stdout:146028888080 2026-02-13T01:25:25.778 INFO:teuthology.orchestra.run.trial091.stdout:253403070473 2026-02-13T01:25:25.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f43340b5820 msgr2=0x7f43340d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f43340b5820 0x7f43340d5cd0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4360123bc0 tx=0x7f4348009260 comp rx=0 tx=0).stop 2026-02-13T01:25:25.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 msgr2=0x7f436011d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 0x7f436011d230 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4354005dc0 tx=0x7f435400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1cf80b57e0 msgr2=0x7f1cf80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1cf80b57e0 0x7f1cf80d5c90 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d10004750 tx=0x7f1d10009260 comp rx=0 tx=0).stop 2026-02-13T01:25:25.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d241131c0 msgr2=0x7f1d24060c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d241131c0 0x7f1d24060c40 secure :-1 s=READY pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d14004750 tx=0x7f1d1400bed0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 shutdown_connections 2026-02-13T01:25:25.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f43340b5820 0x7f43340d5cd0 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 shutdown_connections 2026-02-13T01:25:25.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1cf80b57e0 0x7f1cf80d5c90 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1d24061180 0x7f1d241632a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1d241131c0 0x7f1d24060c40 unknown :-1 s=CLOSED pgs=78 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 --2- 10.20.193.91:0/3561994167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1d2410cfb0 0x7f1d24060700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 >> 10.20.193.91:0/3561994167 conn(0x7f1d240ea8b0 msgr2=0x7f1d2410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4360122b30 0x7f4360122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4360115440 0x7f436011d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 --2- 10.20.193.91:0/3488404959 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f436010f230 0x7f436011d230 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 >> 10.20.193.91:0/3488404959 conn(0x7f43600ecb30 msgr2=0x7f436010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 shutdown_connections 2026-02-13T01:25:25.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 shutdown_connections 2026-02-13T01:25:25.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f43659b36c0 1 -- 10.20.193.91:0/3488404959 wait complete. 2026-02-13T01:25:25.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.779+0000 7f1d2a1096c0 1 -- 10.20.193.91:0/3561994167 wait complete. 2026-02-13T01:25:25.784 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738392 got 34359738391 for osd.0 2026-02-13T01:25:25.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.786+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff9f40f3b80 con 0x7ff9f410be70 2026-02-13T01:25:25.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.786+0000 7ff9e9ffb6c0 1 -- 10.20.193.91:0/1993866245 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff9e40d1d70 con 0x7ff9f410be70 2026-02-13T01:25:25.787 INFO:teuthology.orchestra.run.trial091.stdout:193273528333 2026-02-13T01:25:25.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9d00b5760 msgr2=0x7ff9d00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9d00b5760 0x7ff9d00d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9f40f93c0 tx=0x7ff9dc0093f0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 msgr2=0x7ff9f40f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:25.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 0x7ff9f40f2a80 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9e4009290 tx=0x7ff9e4005fa0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 shutdown_connections 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff9d00b5760 0x7ff9d00d5c10 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff9f40f30b0 0x7ff9f40f8330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff9f4112080 0x7ff9f4172920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 --2- 10.20.193.91:0/1993866245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9f410be70 0x7ff9f40f2a80 unknown :-1 s=CLOSED pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 >> 10.20.193.91:0/1993866245 conn(0x7ff9f40e9770 msgr2=0x7ff9f405f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 shutdown_connections 2026-02-13T01:25:25.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:25.788+0000 7ff9fae146c0 1 -- 10.20.193.91:0/1993866245 wait complete. 2026-02-13T01:25:25.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247827 for osd.3 2026-02-13T01:25:25.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888081 got 146028888080 for osd.5 2026-02-13T01:25:25.841 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607574 got 51539607573 for osd.1 2026-02-13T01:25:25.845 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070474 got 253403070473 for osd.9 2026-02-13T01:25:25.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528334 got 193273528333 for osd.7 2026-02-13T01:25:25.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:25 trial154 ceph-mon[27045]: pgmap v184: 97 pgs: 97 active+clean; 636 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 15 KiB/s wr, 34 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:25:25.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:25 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2029686119' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:26.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:25 trial126 ceph-mon[26569]: pgmap v184: 97 pgs: 97 active+clean; 636 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 15 KiB/s wr, 34 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T01:25:26.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:25 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2029686119' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T01:25:26.714 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T01:25:26.715 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T01:25:26.722 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T01:25:26.734 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T01:25:26.735 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T01:25:26.744 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T01:25:26.785 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T01:25:26.820 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T01:25:26.835 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T01:25:26.839 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.839 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.842 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T01:25:26.845 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T01:25:26.849 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T01:25:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2297409085' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3115912121' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3930117227' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/120444795' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4035975350' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1581429129' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3993430320' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2340978053' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4152255499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3561994167' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3488404959' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:26.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1993866245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:26.883 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.887 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.888 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.888 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.892 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2297409085' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:26.892 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3115912121' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:26.892 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3930117227' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/120444795' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4035975350' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1581429129' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3993430320' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2340978053' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4152255499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3561994167' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3488404959' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:26.893 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1993866245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:26.938 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2297409085' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:26.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3115912121' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:26.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3930117227' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:26.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/120444795' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:26.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4035975350' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1581429129' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3993430320' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2340978053' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4152255499' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3561994167' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3488404959' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:26.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1993866245' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:26.975 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.977 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:26.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/4098527025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58115440 msgr2=0x7f6a58175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/4098527025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58115440 0x7f6a58175de0 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=10435841509048517652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a5400a9b0 tx=0x7f6a5402fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:26.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/4098527025 shutdown_connections 2026-02-13T01:25:26.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/4098527025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58115440 0x7f6a58175de0 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=10435841509048517652 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/4098527025 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810fc20 0x7f6a58114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/4098527025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6a5810f230 0x7f6a5810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/4098527025 >> 10.20.193.91:0/4098527025 conn(0x7f6a580ecb30 msgr2=0x7f6a5810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:26.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/4098527025 shutdown_connections 2026-02-13T01:25:26.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.984+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/4098527025 wait complete. 2026-02-13T01:25:26.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 -- 10.20.193.91:0/2016306658 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c10b360 msgr2=0x7f877c10b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 --2- 10.20.193.91:0/2016306658 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c10b360 0x7f877c10b730 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=16006530839074661316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f876c0099a0 tx=0x7f876c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:26.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 -- 10.20.193.91:0/2016306658 shutdown_connections 2026-02-13T01:25:26.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 --2- 10.20.193.91:0/2016306658 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c1131d0 0x7f877c173b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 --2- 10.20.193.91:0/2016306658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10bd50 0x7f877c1129f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 --2- 10.20.193.91:0/2016306658 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c10b360 0x7f877c10b730 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=16006530839074661316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f6a5f4676c0 1 Processor -- start 2026-02-13T01:25:26.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 -- 10.20.193.91:0/2016306658 >> 10.20.193.91:0/2016306658 conn(0x7f877c062e00 msgr2=0x7f877c109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:26.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 -- 10.20.193.91:0/2016306658 shutdown_connections 2026-02-13T01:25:26.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f87843d06c0 1 -- 10.20.193.91:0/2016306658 wait complete. 2026-02-13T01:25:26.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.985+0000 7f6a5f4676c0 1 -- start start 2026-02-13T01:25:26.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 Processor -- start 2026-02-13T01:25:26.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 -- start start 2026-02-13T01:25:26.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5f4676c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 0x7f6a5811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5f4676c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6a58115440 0x7f6a5811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5f4676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58122ae0 0x7f6a58122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.990 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10b360 0x7f877c10c390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.990 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c1131d0 0x7f877c10c8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.990 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c10ce10 0x7f877c163310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.990 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f877c163850 con 0x7f877c10ce10 2026-02-13T01:25:26.990 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f877c1639c0 con 0x7f877c10b360 2026-02-13T01:25:26.990 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87843d06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f877c163b80 con 0x7f877c1131d0 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5f4676c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6a581234f0 con 0x7f6a58122ae0 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5f4676c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58123660 con 0x7f6a58115440 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 0x7f6a5811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5f4676c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a58123820 con 0x7f6a5810f230 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 0x7f6a5811d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51886/0 (socket says 10.20.193.91:51886) 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 -- 10.20.193.91:0/2111749603 learned_addr learned my addr 10.20.193.91:0/2111749603 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:26.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d9d96c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58122ae0 0x7f6a58122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87819406c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c1131d0 0x7f877c10c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c10ce10 0x7f877c163310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5c9d76c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6a58115440 0x7f6a5811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87819406c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c1131d0 0x7f877c10c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51888/0 (socket says 10.20.193.91:51888) 2026-02-13T01:25:26.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87819406c0 1 -- 10.20.193.91:0/3592403886 learned_addr learned my addr 10.20.193.91:0/3592403886 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:26.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 -- 10.20.193.91:0/3592403886 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c1131d0 msgr2=0x7f877c10c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c1131d0 0x7f877c10c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 -- 10.20.193.91:0/3592403886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10b360 msgr2=0x7f877c10c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87821416c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10b360 0x7f877c10c390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10b360 0x7f877c10c390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 -- 10.20.193.91:0/3592403886 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877800a5b0 con 0x7f877c10ce10 2026-02-13T01:25:26.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87821416c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10b360 0x7f877c10c390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:26.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 -- 10.20.193.91:0/2111749603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6a58115440 msgr2=0x7f6a5811d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6a58115440 0x7f6a5811d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 -- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58122ae0 msgr2=0x7f6a58122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:26.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58122ae0 0x7f6a58122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:26.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 -- 10.20.193.91:0/2111749603 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5400a5b0 con 0x7f6a5810f230 2026-02-13T01:25:26.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f87829426c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c10ce10 0x7f877c163310 secure :-1 s=READY pgs=289 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f877800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:26.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d9d96c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58122ae0 0x7f6a58122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:26.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.986+0000 7f6a5d1d86c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 0x7f6a5811d1e0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a4800b710 tx=0x7f6a4800bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:26.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8778003c40 con 0x7f877c10ce10 2026-02-13T01:25:26.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f877800a070 con 0x7f877c10ce10 2026-02-13T01:25:26.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87780081c0 con 0x7f877c10ce10 2026-02-13T01:25:26.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a48004250 con 0x7f6a5810f230 2026-02-13T01:25:26.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6a48009070 con 0x7f6a5810f230 2026-02-13T01:25:26.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6a4800ccd0 con 0x7f6a5810f230 2026-02-13T01:25:26.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a58163cd0 con 0x7f6a5810f230 2026-02-13T01:25:26.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a58164160 con 0x7f6a5810f230 2026-02-13T01:25:26.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.987+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a58110500 con 0x7f6a5810f230 2026-02-13T01:25:26.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.988+0000 7f87843d06c0 1 -- 10.20.193.91:0/3592403886 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c009590 con 0x7f877c10ce10 2026-02-13T01:25:26.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.988+0000 7f87843d06c0 1 -- 10.20.193.91:0/3592403886 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c164130 con 0x7f877c10ce10 2026-02-13T01:25:26.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.988+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6a480028c0 con 0x7f6a5810f230 2026-02-13T01:25:26.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.989+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8748005310 con 0x7f877c10ce10 2026-02-13T01:25:26.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.989+0000 7f6a467fc6c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6a340b5760 0x7f6a340d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:26.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.989+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f6a480e3d40 con 0x7f6a5810f230 2026-02-13T01:25:26.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.989+0000 7f6a5c9d76c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6a340b5760 0x7f6a340d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:26.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.990+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6a480a9550 con 0x7f6a5810f230 2026-02-13T01:25:26.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.990+0000 7f6a5c9d76c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6a340b5760 0x7f6a340d5c10 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a58123b70 tx=0x7f6a4c009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.990+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8778005030 con 0x7f877c10ce10 2026-02-13T01:25:27.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.991+0000 7f87637fe6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f87580b5760 0x7f87580d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.991+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f87780e4d80 con 0x7f877c10ce10 2026-02-13T01:25:27.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.991+0000 7f87821416c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f87580b5760 0x7f87580d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.992+0000 7f87821416c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f87580b5760 0x7f87580d5c10 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f876c009970 tx=0x7f876c0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:26.992+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f87780a7690 con 0x7f877c10ce10 2026-02-13T01:25:27.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.018+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/3926430784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac10fc20 msgr2=0x7f86ac114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.018+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/3926430784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac10fc20 0x7f86ac114c60 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=13777602863931570727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f869c0098d0 tx=0x7f869c02ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/3926430784 shutdown_connections 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/3926430784 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac115440 0x7f86ac175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/3926430784 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac10fc20 0x7f86ac114c60 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=13777602863931570727 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/3926430784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86ac10f230 0x7f86ac10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/3926430784 >> 10.20.193.91:0/3926430784 conn(0x7f86ac0ecb30 msgr2=0x7f86ac10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/3926430784 shutdown_connections 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/3926430784 wait complete. 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 Processor -- start 2026-02-13T01:25:27.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 -- start start 2026-02-13T01:25:27.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7fee1ed716c0 1 -- 10.20.193.91:0/2986542724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee18115410 msgr2=0x7fee18175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/2986542724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee18115410 0x7fee18175db0 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=18013418614756332696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee1400aa40 tx=0x7fee1402fdf0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 0x7f86ac0f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 0x7f86ac175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86b1cfc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86ac0f5270 0x7f86ac0fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86aaffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 0x7f86ac175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.019+0000 7f86aaffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 0x7f86ac175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37278/0 (socket says 10.20.193.91:37278) 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 0x7f86ac0f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 0x7f86ac0f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51918/0 (socket says 10.20.193.91:51918) 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86b1cfc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0f5960 con 0x7f86ac115440 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86b1cfc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0faa80 con 0x7f86ac0f5270 2026-02-13T01:25:27.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86b1cfc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f86ac0fac40 con 0x7f86ac10f230 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- 10.20.193.91:0/2986542724 shutdown_connections 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/2986542724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee18115410 0x7fee18175db0 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=18013418614756332696 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/2986542724 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee1810fbf0 0x7fee18114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/2986542724 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee1810f200 0x7fee1810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- 10.20.193.91:0/2986542724 >> 10.20.193.91:0/2986542724 conn(0x7fee180ecb00 msgr2=0x7fee1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- 10.20.193.91:0/2986542724 shutdown_connections 2026-02-13T01:25:27.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86aaffd6c0 1 -- 10.20.193.91:0/2763246848 learned_addr learned my addr 10.20.193.91:0/2763246848 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- 10.20.193.91:0/2986542724 wait complete. 2026-02-13T01:25:27.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86abfff6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86ac0f5270 0x7f86ac0fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 -- 10.20.193.91:0/2763246848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86ac0f5270 msgr2=0x7f86ac0fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86ac0f5270 0x7f86ac0fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 -- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 msgr2=0x7f86ac175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 0x7f86ac175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 -- 10.20.193.91:0/2763246848 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c0094c0 con 0x7f86ac10f230 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86aaffd6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 0x7f86ac175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:27.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 Processor -- start 2026-02-13T01:25:27.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7f86ab7fe6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 0x7f86ac0f4c40 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8698005e80 tx=0x7f869800bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- start start 2026-02-13T01:25:27.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee1810f200 0x7fee1811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 0x7fee1811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee18122ae0 0x7fee18122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fee181234f0 con 0x7fee18115410 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fee18123660 con 0x7fee1810f200 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.020+0000 7fee1ed716c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee18123820 con 0x7fee18122ae0 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 0x7fee1811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 0x7fee1811d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37290/0 (socket says 10.20.193.91:37290) 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 -- 10.20.193.91:0/1231581024 learned_addr learned my addr 10.20.193.91:0/1231581024 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee1d2e36c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee18122ae0 0x7fee18122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee1cae26c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee1810f200 0x7fee1811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 -- 10.20.193.91:0/1231581024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee18122ae0 msgr2=0x7fee18122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee18122ae0 0x7fee18122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 -- 10.20.193.91:0/1231581024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee1810f200 msgr2=0x7fee1811d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee1810f200 0x7fee1811d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 -- 10.20.193.91:0/1231581024 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee000094c0 con 0x7fee18115410 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee1cae26c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee1810f200 0x7fee1811d1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0ffff6c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 0x7fee1811d720 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee0000ba30 tx=0x7fee0000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee000044a0 con 0x7fee18115410 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fee00009030 con 0x7fee18115410 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fee000071c0 con 0x7fee18115410 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1400a660 con 0x7fee18115410 2026-02-13T01:25:27.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee18163fd0 con 0x7fee18115410 2026-02-13T01:25:27.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f45a0f576c0 1 -- 10.20.193.91:0/1941558550 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c10f230 msgr2=0x7f459c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/1941558550 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c10f230 0x7f459c10f600 secure :-1 s=READY pgs=82 gs=3 cs=0 l=1 c_cookie=11453881779226747461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45900098d0 tx=0x7f459002ec50 comp rx=0 tx=0).stop 2026-02-13T01:25:27.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 -- 10.20.193.91:0/1941558550 shutdown_connections 2026-02-13T01:25:27.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/1941558550 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c115440 0x7f459c175de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/1941558550 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10fc20 0x7f459c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/1941558550 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c10f230 0x7f459c10f600 unknown :-1 s=CLOSED pgs=82 gs=3 cs=0 l=1 c_cookie=11453881779226747461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 -- 10.20.193.91:0/1941558550 >> 10.20.193.91:0/1941558550 conn(0x7f459c0ecb30 msgr2=0x7f459c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 -- 10.20.193.91:0/1941558550 shutdown_connections 2026-02-13T01:25:27.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f45a0f576c0 1 -- 10.20.193.91:0/1941558550 wait complete. 2026-02-13T01:25:27.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee181104d0 con 0x7fee18115410 2026-02-13T01:25:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8698004a80 con 0x7f86ac10f230 2026-02-13T01:25:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8698009030 con 0x7f86ac10f230 2026-02-13T01:25:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8698005670 con 0x7f86ac10f230 2026-02-13T01:25:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ac0faf20 con 0x7f86ac10f230 2026-02-13T01:25:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.021+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ac0fb2c0 con 0x7f86ac10f230 2026-02-13T01:25:27.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.022+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ac110500 con 0x7f86ac10f230 2026-02-13T01:25:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 Processor -- start 2026-02-13T01:25:27.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 -- start start 2026-02-13T01:25:27.033 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 0x7f459c11d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c115440 0x7f459c11d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 0x7f459c123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f459a5756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 0x7f459c11d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f459a5756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 0x7f459c11d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:52752/0 (socket says 10.20.193.91:52752) 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f459ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 0x7f459c123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f4599d746c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c115440 0x7f459c11d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f459ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 0x7f459c123000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37304/0 (socket says 10.20.193.91:37304) 2026-02-13T01:25:27.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f459a5756c0 1 -- 10.20.193.91:0/857257643 learned_addr learned my addr 10.20.193.91:0/857257643 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f4599d746c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c115440 0x7f459c11d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:51932/0 (socket says 10.20.193.91:51932) 2026-02-13T01:25:27.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f459c123570 con 0x7f459c122b60 2026-02-13T01:25:27.035 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:27.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1236e0 con 0x7f459c10f230 2026-02-13T01:25:27.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1238a0 con 0x7f459c115440 2026-02-13T01:25:27.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459ad766c0 1 -- 10.20.193.91:0/857257643 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c115440 msgr2=0x7f459c11d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459ad766c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c115440 0x7f459c11d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459ad766c0 1 -- 10.20.193.91:0/857257643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 msgr2=0x7f459c11d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459ad766c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 0x7f459c11d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459ad766c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45900094c0 con 0x7f459c122b60 2026-02-13T01:25:27.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459ad766c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 0x7f459c123000 secure :-1 s=READY pgs=292 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f458c006f60 tx=0x7f458c00cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f459a5756c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 0x7f459c11d260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:27.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f869800c7a0 con 0x7f86ac10f230 2026-02-13T01:25:27.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.023+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fee000026b0 con 0x7fee18115410 2026-02-13T01:25:27.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7fee0dffb6c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fedf40b5760 0x7fedf40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fee000e3e70 con 0x7fee18115410 2026-02-13T01:25:27.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7fee1cae26c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fedf40b5760 0x7fedf40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.024+0000 7fee1cae26c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fedf40b5760 0x7fedf40d5c10 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee08005980 tx=0x7fee08005df0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.025+0000 7f86a8ff96c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f86800b5760 0x7f86800d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.025+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fee000a66f0 con 0x7fee18115410 2026-02-13T01:25:27.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.025+0000 7f86aaffd6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f86800b5760 0x7f86800d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.025+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f86980e3bf0 con 0x7f86ac10f230 2026-02-13T01:25:27.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.025+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f86980a9400 con 0x7f86ac10f230 2026-02-13T01:25:27.039 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:27.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.025+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f458c003a30 con 0x7f459c122b60 2026-02-13T01:25:27.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.026+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f458c0054f0 con 0x7f459c122b60 2026-02-13T01:25:27.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.026+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f458c00dde0 con 0x7f459c122b60 2026-02-13T01:25:27.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.026+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c163d50 con 0x7f459c122b60 2026-02-13T01:25:27.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.026+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c164180 con 0x7f459c122b60 2026-02-13T01:25:27.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.026+0000 7f86aaffd6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f86800b5760 0x7f86800d5c10 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86ac0fb5d0 tx=0x7f869c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.027+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459c110500 con 0x7f459c122b60 2026-02-13T01:25:27.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.027+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f458c005030 con 0x7f459c122b60 2026-02-13T01:25:27.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.028+0000 7f45837fe6c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f45740b58b0 0x7f45740d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.028+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f458c0e4d60 con 0x7f459c122b60 2026-02-13T01:25:27.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.028+0000 7f459a5756c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f45740b58b0 0x7f45740d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.028+0000 7f459a5756c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f45740b58b0 0x7f45740d5d60 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4590005980 tx=0x7f4590005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/512939773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc10fc20 msgr2=0x7ff0bc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/512939773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc10fc20 0x7ff0bc114c60 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=3980334431639642046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0b0009970 tx=0x7ff0b002ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/512939773 shutdown_connections 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/512939773 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff0bc115440 0x7ff0bc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/512939773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc10fc20 0x7ff0bc114c60 unknown :-1 s=CLOSED pgs=70 gs=1 cs=0 l=1 c_cookie=3980334431639642046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/512939773 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/512939773 >> 10.20.193.91:0/512939773 conn(0x7ff0bc0ecb30 msgr2=0x7ff0bc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/512939773 shutdown_connections 2026-02-13T01:25:27.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/512939773 wait complete. 2026-02-13T01:25:27.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.030+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f458c0a75a0 con 0x7f459c122b60 2026-02-13T01:25:27.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 Processor -- start 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 -- start start 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc0f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff0bc115440 0x7ff0bc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 0x7ff0bc0fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0f59b0 con 0x7ff0bc10f230 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0faad0 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c3cef6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc0fac90 con 0x7ff0bc115440 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c1a606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc0f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 0x7ff0bc0fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 0x7ff0bc0fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:52768/0 (socket says 10.20.193.91:52768) 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c1a606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc0f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37322/0 (socket says 10.20.193.91:37322) 2026-02-13T01:25:27.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 -- 10.20.193.91:0/1382688076 learned_addr learned my addr 10.20.193.91:0/1382688076 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 -- 10.20.193.91:0/1382688076 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff0bc115440 msgr2=0x7ff0bc175ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff0bc115440 0x7ff0bc175ce0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 -- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 msgr2=0x7ff0bc0f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc0f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 -- 10.20.193.91:0/1382688076 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b0009590 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c1a606c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc0f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0c22616c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 0x7ff0bc0fa590 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0b800c800 tx=0x7ff0b800ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0b8003a30 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.031+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff0b80054f0 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.032+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0b800dc30 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.033+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc0faf70 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.033+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc0fb3d0 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.033+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0bc110500 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.034+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff0b8003b90 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.035+0000 7ff0aaffd6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff0980b5730 0x7ff0980d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.035+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff0b80e4d30 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.035+0000 7ff0c1a606c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff0980b5730 0x7ff0980d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.036+0000 7ff0c1a606c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff0980b5730 0x7ff0980d5be0 secure :-1 s=READY pgs=184 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0ac004750 tx=0x7ff0ac009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.037+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff0b80a7570 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.096+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6a5810fc20 con 0x7f6a5810f230 2026-02-13T01:25:27.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.096+0000 7f6a467fc6c0 1 -- 10.20.193.91:0/2111749603 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a480a9730 con 0x7f6a5810f230 2026-02-13T01:25:27.097 INFO:teuthology.orchestra.run.trial091.stdout:68719476758 2026-02-13T01:25:27.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6a340b5760 msgr2=0x7f6a340d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6a340b5760 0x7f6a340d5c10 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a58123b70 tx=0x7f6a4c009310 comp rx=0 tx=0).stop 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 msgr2=0x7f6a5811d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 0x7f6a5811d1e0 secure :-1 s=READY pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6a4800b710 tx=0x7f6a4800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 shutdown_connections 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6a340b5760 0x7f6a340d5c10 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6a58122ae0 0x7f6a58122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6a58115440 0x7f6a5811d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 --2- 10.20.193.91:0/2111749603 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6a5810f230 0x7f6a5811d1e0 unknown :-1 s=CLOSED pgs=80 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 >> 10.20.193.91:0/2111749603 conn(0x7f6a580ecb30 msgr2=0x7f6a5810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 shutdown_connections 2026-02-13T01:25:27.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.099+0000 7f6a5f4676c0 1 -- 10.20.193.91:0/2111749603 wait complete. 2026-02-13T01:25:27.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 -- 10.20.193.91:0/3812384075 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec1131c0 msgr2=0x7f61ec173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/3812384075 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec1131c0 0x7f61ec173b60 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=5721328934054243764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61e800a9b0 tx=0x7f61e802fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:27.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 -- 10.20.193.91:0/3812384075 shutdown_connections 2026-02-13T01:25:27.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/3812384075 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec1131c0 0x7f61ec173b60 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=5721328934054243764 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/3812384075 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec10d9a0 0x7f61ec1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/3812384075 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f61ec10cfb0 0x7f61ec10d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 -- 10.20.193.91:0/3812384075 >> 10.20.193.91:0/3812384075 conn(0x7f61ec0ea8b0 msgr2=0x7f61ec10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 -- 10.20.193.91:0/3812384075 shutdown_connections 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.102+0000 7f61f30e06c0 1 -- 10.20.193.91:0/3812384075 wait complete. 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 Processor -- start 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 -- start start 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f61ec10cfb0 0x7f61ec0f4b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 0x7f61ec173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec0f51a0 0x7f61ec0fa470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec0f5890 con 0x7f61ec0f51a0 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec0fa9b0 con 0x7f61ec10cfb0 2026-02-13T01:25:27.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f30e06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec0fab70 con 0x7f61ec1131c0 2026-02-13T01:25:27.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8748005890 con 0x7f877c10ce10 2026-02-13T01:25:27.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f16526c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec0f51a0 0x7f61ec0fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61e3fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 0x7f61ec173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61e3fff6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 0x7f61ec173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.154:3300/0 says I am v2:10.20.193.91:41234/0 (socket says 10.20.193.91:41234) 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61e3fff6c0 1 -- 10.20.193.91:0/2645492775 learned_addr learned my addr 10.20.193.91:0/2645492775 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f0e516c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f61ec10cfb0 0x7f61ec0f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f16526c0 1 -- 10.20.193.91:0/2645492775 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 msgr2=0x7f61ec173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f16526c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 0x7f61ec173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f16526c0 1 -- 10.20.193.91:0/2645492775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f61ec10cfb0 msgr2=0x7f61ec0f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f16526c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f61ec10cfb0 0x7f61ec0f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61f16526c0 1 -- 10.20.193.91:0/2645492775 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e800a5b0 con 0x7f61ec0f51a0 2026-02-13T01:25:27.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.103+0000 7f61e3fff6c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 0x7f61ec173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:27.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f87637fe6c0 1 -- 10.20.193.91:0/3592403886 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f87780aa7b0 con 0x7f877c10ce10 2026-02-13T01:25:27.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61f16526c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec0f51a0 0x7f61ec0fa470 secure :-1 s=READY pgs=294 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61e8005570 tx=0x7f61e80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.108 INFO:teuthology.orchestra.run.trial091.stdout:128849018899 2026-02-13T01:25:27.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61e8003a30 con 0x7f61ec0f51a0 2026-02-13T01:25:27.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec0fadf0 con 0x7f61ec0f51a0 2026-02-13T01:25:27.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f61e8030d90 con 0x7f61ec0f51a0 2026-02-13T01:25:27.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61e8037070 con 0x7f61ec0f51a0 2026-02-13T01:25:27.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec0fb270 con 0x7f61ec0f51a0 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.104+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ec10e280 con 0x7f61ec0f51a0 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.106+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f61e8003b90 con 0x7f61ec0f51a0 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f87580b5760 msgr2=0x7f87580d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f87580b5760 0x7f87580d5c10 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f876c009970 tx=0x7f876c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c10ce10 msgr2=0x7f877c163310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c10ce10 0x7f877c163310 secure :-1 s=READY pgs=289 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8778006fd0 tx=0x7f877800cd80 comp rx=0 tx=0).stop 2026-02-13T01:25:27.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 shutdown_connections 2026-02-13T01:25:27.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f61e1ffb6c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f61bc0b5760 0x7f61bc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f87580b5760 0x7f87580d5c10 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f877c10ce10 0x7f877c163310 unknown :-1 s=CLOSED pgs=289 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f877c1131d0 0x7f877c10c8d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 --2- 10.20.193.91:0/3592403886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f877c10b360 0x7f877c10c390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 >> 10.20.193.91:0/3592403886 conn(0x7f877c062e00 msgr2=0x7f877c110700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 shutdown_connections 2026-02-13T01:25:27.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f61e8108e10 con 0x7f61ec0f51a0 2026-02-13T01:25:27.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f87617fa6c0 1 -- 10.20.193.91:0/3592403886 wait complete. 2026-02-13T01:25:27.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f61f0e516c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f61bc0b5760 0x7f61bc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61e80cb690 con 0x7f61ec0f51a0 2026-02-13T01:25:27.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.107+0000 7f61f0e516c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f61bc0b5760 0x7f61bc0d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61dc004750 tx=0x7f61dc009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 -- 10.20.193.91:0/3831091164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c10d9a0 msgr2=0x7fc86c1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 --2- 10.20.193.91:0/3831091164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c10d9a0 0x7fc86c1129e0 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=12086060480109084817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8540098a0 tx=0x7fc85402ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:27.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 -- 10.20.193.91:0/3831091164 shutdown_connections 2026-02-13T01:25:27.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 --2- 10.20.193.91:0/3831091164 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc86c1131c0 0x7fc86c173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 --2- 10.20.193.91:0/3831091164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c10d9a0 0x7fc86c1129e0 unknown :-1 s=CLOSED pgs=72 gs=2 cs=0 l=1 c_cookie=12086060480109084817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 --2- 10.20.193.91:0/3831091164 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c10cfb0 0x7fc86c10d380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 -- 10.20.193.91:0/3831091164 >> 10.20.193.91:0/3831091164 conn(0x7fc86c0ea8b0 msgr2=0x7fc86c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 -- 10.20.193.91:0/3831091164 shutdown_connections 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 -- 10.20.193.91:0/3831091164 wait complete. 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.113+0000 7fc870f676c0 1 Processor -- start 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 -- start start 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc86c10cfb0 0x7fc86c0f4bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 0x7fc86c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c0f5200 0x7fc86c0fa4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c0f58f0 con 0x7fc86c1131c0 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c0faa10 con 0x7fc86c0f5200 2026-02-13T01:25:27.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc86c0fabd0 con 0x7fc86c10cfb0 2026-02-13T01:25:27.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 0x7fc86c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 0x7fc86c173a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44826/0 (socket says 10.20.193.91:44826) 2026-02-13T01:25:27.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 -- 10.20.193.91:0/2240958514 learned_addr learned my addr 10.20.193.91:0/2240958514 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc86a5756c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc86c10cfb0 0x7fc86c0f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc86ad766c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c0f5200 0x7fc86c0fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 -- 10.20.193.91:0/2240958514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc86c10cfb0 msgr2=0x7fc86c0f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc86c10cfb0 0x7fc86c0f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 -- 10.20.193.91:0/2240958514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c0f5200 msgr2=0x7fc86c0fa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c0f5200 0x7fc86c0fa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 -- 10.20.193.91:0/2240958514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc860009590 con 0x7fc86c1131c0 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc86ad766c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c0f5200 0x7fc86c0fa4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:27.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc869d746c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 0x7fc86c173a60 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc854005980 tx=0x7fc85402fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/1812007512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e810fbf0 msgr2=0x7f30e8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/1812007512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e810fbf0 0x7f30e8114c30 secure :-1 s=READY pgs=73 gs=3 cs=0 l=1 c_cookie=15230995668133519920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30d00098a0 tx=0x7f30d002ec40 comp rx=0 tx=0).stop 2026-02-13T01:25:27.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/1812007512 shutdown_connections 2026-02-13T01:25:27.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/1812007512 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e8115410 0x7f30e8175db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/1812007512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e810fbf0 0x7f30e8114c30 unknown :-1 s=CLOSED pgs=73 gs=3 cs=0 l=1 c_cookie=15230995668133519920 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/1812007512 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e810f200 0x7f30e810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/1812007512 >> 10.20.193.91:0/1812007512 conn(0x7f30e80ecb00 msgr2=0x7f30e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/1812007512 shutdown_connections 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/1812007512 wait complete. 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8540045f0 con 0x7fc86c1131c0 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc8540071c0 con 0x7fc86c1131c0 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8540312b0 con 0x7fc86c1131c0 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8540094c0 con 0x7fc86c1131c0 2026-02-13T01:25:27.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.114+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86c0fb0f0 con 0x7fc86c1131c0 2026-02-13T01:25:27.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 Processor -- start 2026-02-13T01:25:27.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc86c10e280 con 0x7fc86c1131c0 2026-02-13T01:25:27.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 -- start start 2026-02-13T01:25:27.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e810f200 0x7f30e80f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e8115410 0x7f30e8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 0x7f30e80fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80f5970 con 0x7f30e810f200 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80faa90 con 0x7f30e80f5280 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30eed1d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80fac50 con 0x7f30e8115410 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30ed28f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 0x7f30e80fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30ed28f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 0x7f30e80fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:51262/0 (socket says 10.20.193.91:51262) 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.115+0000 7f30ed28f6c0 1 -- 10.20.193.91:0/3511872969 learned_addr learned my addr 10.20.193.91:0/3511872969 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30eca8e6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e810f200 0x7f30e80f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30dffff6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e8115410 0x7f30e8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ed28f6c0 1 -- 10.20.193.91:0/3511872969 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e8115410 msgr2=0x7f30e8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ed28f6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e8115410 0x7f30e8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ed28f6c0 1 -- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e810f200 msgr2=0x7f30e80f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ed28f6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e810f200 0x7f30e80f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ed28f6c0 1 -- 10.20.193.91:0/3511872969 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d00094c0 con 0x7f30e80f5280 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30dffff6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e8115410 0x7f30e8175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30eca8e6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e810f200 0x7f30e80f4c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ed28f6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 0x7f30e80fa550 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30e400c9e0 tx=0x7f30e400ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30e4003c40 con 0x7f30e80f5280 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e80faf30 con 0x7f30e80f5280 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e80fb6c0 con 0x7f30e80f5280 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f30e400a070 con 0x7f30e80f5280 2026-02-13T01:25:27.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f30e400dea0 con 0x7f30e80f5280 2026-02-13T01:25:27.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.116+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc854002ae0 con 0x7fc86c1131c0 2026-02-13T01:25:27.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.117+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e81104d0 con 0x7f30e80f5280 2026-02-13T01:25:27.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.117+0000 7fc8537fe6c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8440b58b0 0x7fc8440d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.117+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fc854107c80 con 0x7fc86c1131c0 2026-02-13T01:25:27.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.117+0000 7fc86a5756c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8440b58b0 0x7fc8440d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.118+0000 7fc86a5756c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8440b58b0 0x7fc8440d5d60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc860005fd0 tx=0x7fc860009310 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.119+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f30e4005030 con 0x7f30e80f5280 2026-02-13T01:25:27.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.119+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8540ca4c0 con 0x7fc86c1131c0 2026-02-13T01:25:27.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.120+0000 7f30ddffb6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f30c40b57d0 0x7f30c40d5c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.120+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f30e40e4c00 con 0x7f30e80f5280 2026-02-13T01:25:27.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.120+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f30e411d5e0 con 0x7f30e80f5280 2026-02-13T01:25:27.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.120+0000 7f30eca8e6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f30c40b57d0 0x7f30c40d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.120+0000 7f30eca8e6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f30c40b57d0 0x7f30c40d5c80 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30d8004750 tx=0x7f30d8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.134+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f86ac10fc20 con 0x7f86ac10f230 2026-02-13T01:25:27.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.135+0000 7f86a8ff96c0 1 -- 10.20.193.91:0/2763246848 <== mon.1 v2:10.20.193.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f86980a95e0 con 0x7f86ac10f230 2026-02-13T01:25:27.135 INFO:teuthology.orchestra.run.trial091.stdout:223338299404 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f86800b5760 msgr2=0x7f86800d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f86800b5760 0x7f86800d5c10 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f86ac0fb5d0 tx=0x7f869c005910 comp rx=0 tx=0).stop 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 msgr2=0x7f86ac0f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 0x7f86ac0f4c40 secure :-1 s=READY pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8698005e80 tx=0x7f869800bbf0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 shutdown_connections 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f86800b5760 0x7f86800d5c10 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86ac0f5270 0x7f86ac0fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f86ac115440 0x7f86ac175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 --2- 10.20.193.91:0/2763246848 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f86ac10f230 0x7f86ac0f4c40 unknown :-1 s=CLOSED pgs=81 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 >> 10.20.193.91:0/2763246848 conn(0x7f86ac0ecb30 msgr2=0x7f86ac10d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 shutdown_connections 2026-02-13T01:25:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.137+0000 7f86b1cfc6c0 1 -- 10.20.193.91:0/2763246848 wait complete. 2026-02-13T01:25:27.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.138+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f459c10fc20 con 0x7f459c122b60 2026-02-13T01:25:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.139+0000 7f45837fe6c0 1 -- 10.20.193.91:0/857257643 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f458c0aa750 con 0x7f459c122b60 2026-02-13T01:25:27.140 INFO:teuthology.orchestra.run.trial091.stdout:300647710729 2026-02-13T01:25:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.139+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fee1810fbf0 con 0x7fee18115410 2026-02-13T01:25:27.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.140+0000 7fee0dffb6c0 1 -- 10.20.193.91:0/1231581024 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fee000a98a0 con 0x7fee18115410 2026-02-13T01:25:27.141 INFO:teuthology.orchestra.run.trial091.stdout:270582939657 2026-02-13T01:25:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.142+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f45740b58b0 msgr2=0x7f45740d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.142+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f45740b58b0 0x7f45740d5d60 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4590005980 tx=0x7f4590005910 comp rx=0 tx=0).stop 2026-02-13T01:25:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.142+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 msgr2=0x7f459c123000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.142+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 0x7f459c123000 secure :-1 s=READY pgs=292 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f458c006f60 tx=0x7f458c00cec0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fedf40b5760 msgr2=0x7fedf40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fedf40b5760 0x7fedf40d5c10 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee08005980 tx=0x7fee08005df0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 msgr2=0x7fee1811d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 shutdown_connections 2026-02-13T01:25:27.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f45740b58b0 0x7f45740d5d60 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f459c122b60 0x7f459c123000 unknown :-1 s=CLOSED pgs=292 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 0x7fee1811d720 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee0000ba30 tx=0x7fee0000bf00 comp rx=0 tx=0).stop 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 shutdown_connections 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fedf40b5760 0x7fedf40d5c10 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fee18122ae0 0x7fee18122f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fee18115410 0x7fee1811d720 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 --2- 10.20.193.91:0/1231581024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee1810f200 0x7fee1811d1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 >> 10.20.193.91:0/1231581024 conn(0x7fee180ecb00 msgr2=0x7fee1810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f459c115440 0x7f459c11d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7f45a0f576c0 1 --2- 10.20.193.91:0/857257643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f459c10f230 0x7f459c11d260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.143+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 >> 10.20.193.91:0/857257643 conn(0x7f459c0ecb30 msgr2=0x7f459c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.144+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 shutdown_connections 2026-02-13T01:25:27.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.144+0000 7fee1ed716c0 1 -- 10.20.193.91:0/1231581024 wait complete. 2026-02-13T01:25:27.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.144+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 shutdown_connections 2026-02-13T01:25:27.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.144+0000 7f45a0f576c0 1 -- 10.20.193.91:0/857257643 wait complete. 2026-02-13T01:25:27.156 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476758 got 68719476758 for osd.2 2026-02-13T01:25:27.156 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.161+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff0bc0f5de0 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.161+0000 7ff0aaffd6c0 1 -- 10.20.193.91:0/1382688076 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff0b80aa720 con 0x7ff0bc0f52c0 2026-02-13T01:25:27.162 INFO:teuthology.orchestra.run.trial091.stdout:176093659152 2026-02-13T01:25:27.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff0980b5730 msgr2=0x7ff0980d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff0980b5730 0x7ff0980d5be0 secure :-1 s=READY pgs=184 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0ac004750 tx=0x7ff0ac009260 comp rx=0 tx=0).stop 2026-02-13T01:25:27.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 msgr2=0x7ff0bc0fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 0x7ff0bc0fa590 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0b800c800 tx=0x7ff0b800ccd0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.166 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018899 got 128849018899 for osd.4 2026-02-13T01:25:27.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 shutdown_connections 2026-02-13T01:25:27.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff0980b5730 0x7ff0980d5be0 unknown :-1 s=CLOSED pgs=184 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0bc0f52c0 0x7ff0bc0fa590 unknown :-1 s=CLOSED pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff0bc115440 0x7ff0bc175ce0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 --2- 10.20.193.91:0/1382688076 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff0bc10f230 0x7ff0bc0f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.164+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 >> 10.20.193.91:0/1382688076 conn(0x7ff0bc0ecb30 msgr2=0x7ff0bc113cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.165+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 shutdown_connections 2026-02-13T01:25:27.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.165+0000 7ff0c3cef6c0 1 -- 10.20.193.91:0/1382688076 wait complete. 2026-02-13T01:25:27.167 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 -- 10.20.193.91:0/1895662085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 msgr2=0x7facf0173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/1895662085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0173b60 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=7986287115597335805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face000aa70 tx=0x7face002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 -- 10.20.193.91:0/1895662085 shutdown_connections 2026-02-13T01:25:27.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/1895662085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0173b60 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=7986287115597335805 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/1895662085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7facf010d9a0 0x7facf01129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/1895662085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 0x7facf010d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 -- 10.20.193.91:0/1895662085 >> 10.20.193.91:0/1895662085 conn(0x7facf00ea8b0 msgr2=0x7facf010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 -- 10.20.193.91:0/1895662085 shutdown_connections 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7facf4fc86c0 1 -- 10.20.193.91:0/1895662085 wait complete. 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 Processor -- start 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 -- start start 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 0x7facf010ac90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0156250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7facf0156790 0x7facf0156c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7facf015b2a0 con 0x7facf01131c0 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7facf015b410 con 0x7facf010cfb0 2026-02-13T01:25:27.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facf4fc86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7facf015b5d0 con 0x7facf0156790 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4066241991 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a241131c0 msgr2=0x7f3a24173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4066241991 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a241131c0 0x7f3a24173b60 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=3380317133485990951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1800aa70 tx=0x7f3a1802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4066241991 shutdown_connections 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4066241991 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a241131c0 0x7f3a24173b60 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=3380317133485990951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4066241991 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a2410d9a0 0x7f3a241129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4066241991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a2410cfb0 0x7f3a2410d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4066241991 >> 10.20.193.91:0/4066241991 conn(0x7f3a240ea8b0 msgr2=0x7f3a2410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4066241991 shutdown_connections 2026-02-13T01:25:27.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.166+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4066241991 wait complete. 2026-02-13T01:25:27.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facee5756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 0x7facf010ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7faceed766c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7facf0156790 0x7facf0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0156250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0156250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44888/0 (socket says 10.20.193.91:44888) 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 -- 10.20.193.91:0/472653020 learned_addr learned my addr 10.20.193.91:0/472653020 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facee5756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 0x7facf010ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:51298/0 (socket says 10.20.193.91:51298) 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 -- 10.20.193.91:0/472653020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7facf0156790 msgr2=0x7facf0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7facf0156790 0x7facf0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 Processor -- start 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 -- start start 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 0x7f3a24060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a241131c0 0x7f3a24060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a24061180 0x7f3a24163200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24062700 con 0x7f3a2410cfb0 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24163740 con 0x7f3a241131c0 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24163900 con 0x7f3a24061180 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 0x7f3a24060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 0x7f3a24060700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44878/0 (socket says 10.20.193.91:44878) 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 -- 10.20.193.91:0/4290297025 learned_addr learned my addr 10.20.193.91:0/4290297025 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a289826c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a24061180 0x7f3a24163200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 -- 10.20.193.91:0/4290297025 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a24061180 msgr2=0x7f3a24163200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a24061180 0x7f3a24163200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 -- 10.20.193.91:0/472653020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 msgr2=0x7facf010ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 0x7facf010ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7facedd746c0 1 -- 10.20.193.91:0/472653020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face000a660 con 0x7facf01131c0 2026-02-13T01:25:27.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 -- 10.20.193.91:0/882376863 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654115440 msgr2=0x7f9654175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 --2- 10.20.193.91:0/882376863 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654115440 0x7f9654175de0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=4836992514538078137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965000aa70 tx=0x7f965002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 -- 10.20.193.91:0/882376863 shutdown_connections 2026-02-13T01:25:27.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 --2- 10.20.193.91:0/882376863 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654115440 0x7f9654175de0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=4836992514538078137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 --2- 10.20.193.91:0/882376863 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f965410fc20 0x7f9654114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 --2- 10.20.193.91:0/882376863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 -- 10.20.193.91:0/882376863 >> 10.20.193.91:0/882376863 conn(0x7f96540ecb30 msgr2=0x7f965410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 -- 10.20.193.91:0/4290297025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a241131c0 msgr2=0x7f3a24060c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a241131c0 0x7f3a24060c40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 -- 10.20.193.91:0/4290297025 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1800a660 con 0x7f3a2410cfb0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a289826c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a24061180 0x7f3a24163200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a23fff6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 0x7f3a24060700 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1000b710 tx=0x7f3a1000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a10004250 con 0x7f3a2410cfb0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a24163be0 con 0x7f3a2410cfb0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.167+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a24164110 con 0x7f3a2410cfb0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3a10009070 con 0x7f3a2410cfb0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a1000cde0 con 0x7f3a2410cfb0 2026-02-13T01:25:27.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2410e280 con 0x7f3a2410cfb0 2026-02-13T01:25:27.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 -- 10.20.193.91:0/882376863 shutdown_connections 2026-02-13T01:25:27.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.168+0000 7f965c3576c0 1 -- 10.20.193.91:0/882376863 wait complete. 2026-02-13T01:25:27.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.169+0000 7facedd746c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0156250 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facd800b750 tx=0x7facd800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.169+0000 7f965c3576c0 1 Processor -- start 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.169+0000 7f965c3576c0 1 -- start start 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965411d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9654115440 0x7f965411d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654122b00 0x7f9654122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f96541234e0 con 0x7f9654122b00 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9654123650 con 0x7f965410f230 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9654123810 con 0x7f9654115440 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965411d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.91:51306/0 (socket says 10.20.193.91:51306) 2026-02-13T01:25:27.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 -- 10.20.193.91:0/1283640585 learned_addr learned my addr 10.20.193.91:0/1283640585 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3a100028c0 con 0x7f3a2410cfb0 2026-02-13T01:25:27.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 -- 10.20.193.91:0/1283640585 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9654115440 msgr2=0x7f965411d740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9654115440 0x7f965411d740 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 -- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654122b00 msgr2=0x7f9654122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654122b00 0x7f9654122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 -- 10.20.193.91:0/1283640585 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965000a660 con 0x7f965410f230 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965a0c86c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965411d200 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964400b6c0 tx=0x7f964400bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f3a217fa6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39f80b57e0 0x7f39f80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9644004560 con 0x7f965410f230 2026-02-13T01:25:27.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9654163c90 con 0x7f965410f230 2026-02-13T01:25:27.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f3a100e3ce0 con 0x7f3a2410cfb0 2026-02-13T01:25:27.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.170+0000 7f3a237fe6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39f80b57e0 0x7f39f80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.171+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96541641c0 con 0x7f965410f230 2026-02-13T01:25:27.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.171+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9644009030 con 0x7f965410f230 2026-02-13T01:25:27.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.171+0000 7f3a237fe6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39f80b57e0 0x7f39f80d5c90 secure :-1 s=READY pgs=188 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a2410fa70 tx=0x7f3a14005cc0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.171+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f964400ccb0 con 0x7f965410f230 2026-02-13T01:25:27.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.171+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9654110500 con 0x7f965410f230 2026-02-13T01:25:27.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3a100a6520 con 0x7f3a2410cfb0 2026-02-13T01:25:27.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facd8004a80 con 0x7facf01131c0 2026-02-13T01:25:27.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7facd8009030 con 0x7facf01131c0 2026-02-13T01:25:27.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7facd800cd00 con 0x7facf01131c0 2026-02-13T01:25:27.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf00605e0 con 0x7facf01131c0 2026-02-13T01:25:27.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf0060a70 con 0x7facf01131c0 2026-02-13T01:25:27.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.172+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9644005080 con 0x7f965410f230 2026-02-13T01:25:27.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.173+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf010e280 con 0x7facf01131c0 2026-02-13T01:25:27.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.173+0000 7f964b7fe6c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96240b5660 0x7f96240d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.173+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f96440e3c00 con 0x7f965410f230 2026-02-13T01:25:27.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.173+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f96440a6440 con 0x7f965410f230 2026-02-13T01:25:27.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.174+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7facd8005020 con 0x7facf01131c0 2026-02-13T01:25:27.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.175+0000 7facd77fe6c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7facc80b5830 0x7facc80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.175+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7facd80e3a70 con 0x7facf01131c0 2026-02-13T01:25:27.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.175+0000 7facee5756c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7facc80b5830 0x7facc80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.174+0000 7f96598c76c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96240b5660 0x7f96240d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.175+0000 7f96598c76c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96240b5660 0x7f96240d5b10 secure :-1 s=READY pgs=189 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9654123b90 tx=0x7f963c0093b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.175+0000 7facee5756c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7facc80b5830 0x7facc80d5ce0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face4005fd0 tx=0x7face40093f0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.177+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7facd80a62b0 con 0x7facf01131c0 2026-02-13T01:25:27.202 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939657 got 270582939657 for osd.10 2026-02-13T01:25:27.203 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710728 got 300647710729 for osd.11 2026-02-13T01:25:27.204 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.209 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299404 got 223338299404 for osd.8 2026-02-13T01:25:27.210 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.214 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659152 got 176093659152 for osd.6 2026-02-13T01:25:27.215 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.223+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f61ec10d9a0 con 0x7f61ec0f51a0 2026-02-13T01:25:27.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.224+0000 7f61e1ffb6c0 1 -- 10.20.193.91:0/2645492775 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f61e80ce840 con 0x7f61ec0f51a0 2026-02-13T01:25:27.224 INFO:teuthology.orchestra.run.trial091.stdout:34359738393 2026-02-13T01:25:27.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f61bc0b5760 msgr2=0x7f61bc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f61bc0b5760 0x7f61bc0d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61dc004750 tx=0x7f61dc009260 comp rx=0 tx=0).stop 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec0f51a0 msgr2=0x7f61ec0fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec0f51a0 0x7f61ec0fa470 secure :-1 s=READY pgs=294 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61e8005570 tx=0x7f61e80055a0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 shutdown_connections 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f61bc0b5760 0x7f61bc0d5c10 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f61ec0f51a0 0x7f61ec0fa470 unknown :-1 s=CLOSED pgs=294 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f61ec1131c0 0x7f61ec173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 --2- 10.20.193.91:0/2645492775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f61ec10cfb0 0x7f61ec0f4b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 >> 10.20.193.91:0/2645492775 conn(0x7f61ec0ea8b0 msgr2=0x7f61ec10e770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 shutdown_connections 2026-02-13T01:25:27.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.226+0000 7f61f30e06c0 1 -- 10.20.193.91:0/2645492775 wait complete. 2026-02-13T01:25:27.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.229+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f30e80f5da0 con 0x7f30e80f5280 2026-02-13T01:25:27.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.229+0000 7f30ddffb6c0 1 -- 10.20.193.91:0/3511872969 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f30e40a7440 con 0x7f30e80f5280 2026-02-13T01:25:27.229 INFO:teuthology.orchestra.run.trial091.stdout:146028888082 2026-02-13T01:25:27.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f30c40b57d0 msgr2=0x7f30c40d5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f30c40b57d0 0x7f30c40d5c80 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30d8004750 tx=0x7f30d8009260 comp rx=0 tx=0).stop 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 msgr2=0x7f30e80fa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 0x7f30e80fa550 secure :-1 s=READY pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30e400c9e0 tx=0x7f30e400ceb0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 shutdown_connections 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f30c40b57d0 0x7f30c40d5c80 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f30e80f5280 0x7f30e80fa550 unknown :-1 s=CLOSED pgs=74 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f30e8115410 0x7f30e8175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 --2- 10.20.193.91:0/3511872969 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f30e810f200 0x7f30e80f4c50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 >> 10.20.193.91:0/3511872969 conn(0x7f30e80ecb00 msgr2=0x7f30e810d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 shutdown_connections 2026-02-13T01:25:27.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.231+0000 7f30eed1d6c0 1 -- 10.20.193.91:0/3511872969 wait complete. 2026-02-13T01:25:27.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.234+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc86c0fb310 con 0x7fc86c1131c0 2026-02-13T01:25:27.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.234+0000 7fc8537fe6c0 1 -- 10.20.193.91:0/2240958514 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8540cd670 con 0x7fc86c1131c0 2026-02-13T01:25:27.235 INFO:teuthology.orchestra.run.trial091.stdout:98784247828 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8440b58b0 msgr2=0x7fc8440d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8440b58b0 0x7fc8440d5d60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc860005fd0 tx=0x7fc860009310 comp rx=0 tx=0).stop 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 msgr2=0x7fc86c173a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 0x7fc86c173a60 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc854005980 tx=0x7fc85402fb50 comp rx=0 tx=0).stop 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 shutdown_connections 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc8440b58b0 0x7fc8440d5d60 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc86c0f5200 0x7fc86c0fa4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc86c1131c0 0x7fc86c173a60 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 --2- 10.20.193.91:0/2240958514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc86c10cfb0 0x7fc86c0f4bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 >> 10.20.193.91:0/2240958514 conn(0x7fc86c0ea8b0 msgr2=0x7fc86c10f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 shutdown_connections 2026-02-13T01:25:27.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.236+0000 7fc870f676c0 1 -- 10.20.193.91:0/2240958514 wait complete. 2026-02-13T01:25:27.272 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738392 got 34359738393 for osd.0 2026-02-13T01:25:27.272 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.274+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7facf010d9a0 con 0x7facf01131c0 2026-02-13T01:25:27.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.275+0000 7facd77fe6c0 1 -- 10.20.193.91:0/472653020 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7facd80a9460 con 0x7facf01131c0 2026-02-13T01:25:27.276 INFO:teuthology.orchestra.run.trial091.stdout:253403070475 2026-02-13T01:25:27.276 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.275+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3a24061a00 con 0x7f3a2410cfb0 2026-02-13T01:25:27.276 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.276+0000 7f3a217fa6c0 1 -- 10.20.193.91:0/4290297025 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3a100a96d0 con 0x7f3a2410cfb0 2026-02-13T01:25:27.276 INFO:teuthology.orchestra.run.trial091.stdout:193273528335 2026-02-13T01:25:27.278 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888081 got 146028888082 for osd.5 2026-02-13T01:25:27.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f965410f600 con 0x7f965410f230 2026-02-13T01:25:27.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7f964b7fe6c0 1 -- 10.20.193.91:0/1283640585 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96440a95f0 con 0x7f965410f230 2026-02-13T01:25:27.279 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7facc80b5830 msgr2=0x7facc80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7facc80b5830 0x7facc80d5ce0 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face4005fd0 tx=0x7face40093f0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 msgr2=0x7facf0156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0156250 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facd800b750 tx=0x7facd800bc20 comp rx=0 tx=0).stop 2026-02-13T01:25:27.280 INFO:teuthology.orchestra.run.trial091.stdout:51539607574 2026-02-13T01:25:27.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 shutdown_connections 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7facc80b5830 0x7facc80d5ce0 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7facf0156790 0x7facf0156c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7facf01131c0 0x7facf0156250 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 --2- 10.20.193.91:0/472653020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facf010cfb0 0x7facf010ac90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.277+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 >> 10.20.193.91:0/472653020 conn(0x7facf00ea8b0 msgr2=0x7facf010b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 shutdown_connections 2026-02-13T01:25:27.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7facf4fc86c0 1 -- 10.20.193.91:0/472653020 wait complete. 2026-02-13T01:25:27.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39f80b57e0 msgr2=0x7f39f80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39f80b57e0 0x7f39f80d5c90 secure :-1 s=READY pgs=188 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a2410fa70 tx=0x7f3a14005cc0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 msgr2=0x7f3a24060700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 0x7f3a24060700 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a1000b710 tx=0x7f3a1000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 shutdown_connections 2026-02-13T01:25:27.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39f80b57e0 0x7f39f80d5c90 unknown :-1 s=CLOSED pgs=188 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3a24061180 0x7f3a24163200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3a241131c0 0x7f3a24060c40 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 --2- 10.20.193.91:0/4290297025 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3a2410cfb0 0x7f3a24060700 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 >> 10.20.193.91:0/4290297025 conn(0x7f3a240ea8b0 msgr2=0x7f3a2410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 shutdown_connections 2026-02-13T01:25:27.283 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.278+0000 7f3a2a40c6c0 1 -- 10.20.193.91:0/4290297025 wait complete. 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96240b5660 msgr2=0x7f96240d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96240b5660 0x7f96240d5b10 secure :-1 s=READY pgs=189 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9654123b90 tx=0x7f963c0093b0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 msgr2=0x7f965411d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965411d200 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f964400b6c0 tx=0x7f964400bb90 comp rx=0 tx=0).stop 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 shutdown_connections 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96240b5660 0x7f96240d5b10 unknown :-1 s=CLOSED pgs=189 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9654122b00 0x7f9654122fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9654115440 0x7f965411d740 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 --2- 10.20.193.91:0/1283640585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f965410f230 0x7f965411d200 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.284 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 >> 10.20.193.91:0/1283640585 conn(0x7f96540ecb30 msgr2=0x7f965410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 shutdown_connections 2026-02-13T01:25:27.285 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.280+0000 7f965c3576c0 1 -- 10.20.193.91:0/1283640585 wait complete. 2026-02-13T01:25:27.287 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247828 for osd.3 2026-02-13T01:25:27.287 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.326 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070474 got 253403070475 for osd.9 2026-02-13T01:25:27.326 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.329 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607574 got 51539607574 for osd.1 2026-02-13T01:25:27.329 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.332 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528334 got 193273528335 for osd.7 2026-02-13T01:25:27.333 DEBUG:teuthology.parallel:result is None 2026-02-13T01:25:27.333 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T01:25:27.333 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:27.488 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 -- 10.20.193.91:0/9929455 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300062fd0 msgr2=0x7ff300063400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/9929455 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300062fd0 0x7ff300063400 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=8384607511852102578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f4009970 tx=0x7ff2f402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 -- 10.20.193.91:0/9929455 shutdown_connections 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/9929455 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 0x7ff300179eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/9929455 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300062fd0 0x7ff300063400 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=8384607511852102578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/9929455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff3000669a0 0x7ff3000629b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 -- 10.20.193.91:0/9929455 >> 10.20.193.91:0/9929455 conn(0x7ff3000ecb00 msgr2=0x7ff30010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.602+0000 7ff3075e46c0 1 -- 10.20.193.91:0/9929455 shutdown_connections 2026-02-13T01:25:27.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- 10.20.193.91:0/9929455 wait complete. 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 Processor -- start 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- start start 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff300062fd0 0x7ff300163450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 0x7ff300163990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 0x7ff3001691f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff300169760 con 0x7ff300168d50 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff3001698d0 con 0x7ff300062fd0 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff300169a90 con 0x7ff300159a50 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 0x7ff3001691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 0x7ff3001691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44926/0 (socket says 10.20.193.91:44926) 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 -- 10.20.193.91:0/1000773717 learned_addr learned my addr 10.20.193.91:0/1000773717 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:27.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3053556c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff300062fd0 0x7ff300163450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff304b546c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 0x7ff300163990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 -- 10.20.193.91:0/1000773717 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 msgr2=0x7ff300163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 0x7ff300163990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 -- 10.20.193.91:0/1000773717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff300062fd0 msgr2=0x7ff300163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff300062fd0 0x7ff300163450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 -- 10.20.193.91:0/1000773717 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f4009590 con 0x7ff300168d50 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff304b546c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 0x7ff300163990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3053556c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff300062fd0 0x7ff300163450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff305b566c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 0x7ff3001691f0 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2fc006ea0 tx=0x7ff2fc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2fc003a30 con 0x7ff300168d50 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff300157910 con 0x7ff300168d50 2026-02-13T01:25:27.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff2fc0054f0 con 0x7ff300168d50 2026-02-13T01:25:27.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff2fc00dcd0 con 0x7ff300168d50 2026-02-13T01:25:27.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.603+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff300157da0 con 0x7ff300168d50 2026-02-13T01:25:27.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.604+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff300063ec0 con 0x7ff300168d50 2026-02-13T01:25:27.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.605+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff2fc005030 con 0x7ff300168d50 2026-02-13T01:25:27.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.606+0000 7ff2ee7fc6c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2dc0b56e0 0x7ff2dc0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:27.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.606+0000 7ff3053556c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2dc0b56e0 0x7ff2dc0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:27.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.606+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff2fc0e4ea0 con 0x7ff300168d50 2026-02-13T01:25:27.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.606+0000 7ff3053556c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2dc0b56e0 0x7ff2dc0d5b90 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f0004750 tx=0x7ff2f0009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:27.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.606+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff2fc0a76e0 con 0x7ff300168d50 2026-02-13T01:25:27.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.693+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3000669a0 con 0x7ff2dc0b56e0 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: pgmap v185: 97 pgs: 97 active+clean; 636 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 31 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2111749603' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3592403886' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2763246848' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/857257643' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1231581024' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1382688076' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2645492775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3511872969' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:27.694 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2240958514' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:27.695 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/472653020' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:27.695 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4290297025' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:27.695 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1283640585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:27.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.695+0000 7ff2ee7fc6c0 1 -- 10.20.193.91:0/1000773717 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259133 (secure 0 0 0) 0x7ff3000669a0 con 0x7ff2dc0b56e0 2026-02-13T01:25:27.698 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:27.699 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-13T01:25:27.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.696+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2dc0b56e0 msgr2=0x7ff2dc0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.696+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2dc0b56e0 0x7ff2dc0d5b90 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2f0004750 tx=0x7ff2f0009260 comp rx=0 tx=0).stop 2026-02-13T01:25:27.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.696+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 msgr2=0x7ff3001691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:27.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.696+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 0x7ff3001691f0 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff2fc006ea0 tx=0x7ff2fc00cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 shutdown_connections 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2dc0b56e0 0x7ff2dc0d5b90 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff300168d50 0x7ff3001691f0 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff300159a50 0x7ff300163990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 --2- 10.20.193.91:0/1000773717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff300062fd0 0x7ff300163450 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 >> 10.20.193.91:0/1000773717 conn(0x7ff3000ecb00 msgr2=0x7ff30010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 shutdown_connections 2026-02-13T01:25:27.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:27.697+0000 7ff3075e46c0 1 -- 10.20.193.91:0/1000773717 wait complete. 2026-02-13T01:25:27.736 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2026-02-13T01:25:26.557283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651208,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":213,"num_read_kb":214,"num_write":419,"num_write_kb":3848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334056,"kb_used_data":10488,"kb_used_omap":474,"kb_used_meta":322854,"kb_avail":8807704344,"statfs":{"total":9019431321600,"available":9019089248256,"internally_reserved":0,"allocated":10739712,"data_stored":6877764,"data_compressed":183798,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":485376,"internal_metadata":330602496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58072,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":99,"num_read_kb":115,"num_write":154,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001482"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626783+0000","last_change":"2026-02-13T01:25:13.598845+0000","last_active":"2026-02-13T01:25:22.626783+0000","last_peered":"2026-02-13T01:25:22.626783+0000","last_clean":"2026-02-13T01:25:22.626783+0000","last_became_active":"2026-02-13T01:25:13.598609+0000","last_became_peered":"2026-02-13T01:25:13.598609+0000","last_unstale":"2026-02-13T01:25:22.626783+0000","last_undegraded":"2026-02-13T01:25:22.626783+0000","last_fullsized":"2026-02-13T01:25:22.626783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:13.127033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628742+0000","last_change":"2026-02-13T01:25:13.599778+0000","last_active":"2026-02-13T01:25:22.628742+0000","last_peered":"2026-02-13T01:25:22.628742+0000","last_clean":"2026-02-13T01:25:22.628742+0000","last_became_active":"2026-02-13T01:25:13.599585+0000","last_became_peered":"2026-02-13T01:25:13.599585+0000","last_unstale":"2026-02-13T01:25:22.628742+0000","last_undegraded":"2026-02-13T01:25:22.628742+0000","last_fullsized":"2026-02-13T01:25:22.628742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:23:42.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628598+0000","last_change":"2026-02-13T01:25:13.602206+0000","last_active":"2026-02-13T01:25:22.628598+0000","last_peered":"2026-02-13T01:25:22.628598+0000","last_clean":"2026-02-13T01:25:22.628598+0000","last_became_active":"2026-02-13T01:25:13.602099+0000","last_became_peered":"2026-02-13T01:25:13.602099+0000","last_unstale":"2026-02-13T01:25:22.628598+0000","last_undegraded":"2026-02-13T01:25:22.628598+0000","last_fullsized":"2026-02-13T01:25:22.628598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:31.903965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626504+0000","last_change":"2026-02-13T01:25:13.596389+0000","last_active":"2026-02-13T01:25:22.626504+0000","last_peered":"2026-02-13T01:25:22.626504+0000","last_clean":"2026-02-13T01:25:22.626504+0000","last_became_active":"2026-02-13T01:25:13.596165+0000","last_became_peered":"2026-02-13T01:25:13.596165+0000","last_unstale":"2026-02-13T01:25:22.626504+0000","last_undegraded":"2026-02-13T01:25:22.626504+0000","last_fullsized":"2026-02-13T01:25:22.626504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:43:09.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.631936+0000","last_change":"2026-02-13T01:25:22.631892+0000","last_active":"2026-02-13T01:25:22.631936+0000","last_peered":"2026-02-13T01:25:22.631936+0000","last_clean":"2026-02-13T01:25:22.631936+0000","last_became_active":"2026-02-13T01:25:22.631664+0000","last_became_peered":"2026-02-13T01:25:22.631664+0000","last_unstale":"2026-02-13T01:25:22.631936+0000","last_undegraded":"2026-02-13T01:25:22.631936+0000","last_fullsized":"2026-02-13T01:25:22.631936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:54.247371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626116+0000","last_change":"2026-02-13T01:25:13.595155+0000","last_active":"2026-02-13T01:25:22.626116+0000","last_peered":"2026-02-13T01:25:22.626116+0000","last_clean":"2026-02-13T01:25:22.626116+0000","last_became_active":"2026-02-13T01:25:13.594858+0000","last_became_peered":"2026-02-13T01:25:13.594858+0000","last_unstale":"2026-02-13T01:25:22.626116+0000","last_undegraded":"2026-02-13T01:25:22.626116+0000","last_fullsized":"2026-02-13T01:25:22.626116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:29:34.717120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627859+0000","last_change":"2026-02-13T01:25:13.596326+0000","last_active":"2026-02-13T01:25:22.627859+0000","last_peered":"2026-02-13T01:25:22.627859+0000","last_clean":"2026-02-13T01:25:22.627859+0000","last_became_active":"2026-02-13T01:25:13.595964+0000","last_became_peered":"2026-02-13T01:25:13.595964+0000","last_unstale":"2026-02-13T01:25:22.627859+0000","last_undegraded":"2026-02-13T01:25:22.627859+0000","last_fullsized":"2026-02-13T01:25:22.627859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:07:18.022160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629718+0000","last_change":"2026-02-13T01:25:13.598247+0000","last_active":"2026-02-13T01:25:22.629718+0000","last_peered":"2026-02-13T01:25:22.629718+0000","last_clean":"2026-02-13T01:25:22.629718+0000","last_became_active":"2026-02-13T01:25:13.598098+0000","last_became_peered":"2026-02-13T01:25:13.598098+0000","last_unstale":"2026-02-13T01:25:22.629718+0000","last_undegraded":"2026-02-13T01:25:22.629718+0000","last_fullsized":"2026-02-13T01:25:22.629718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:41.227689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642811+0000","last_change":"2026-02-13T01:25:13.601183+0000","last_active":"2026-02-13T01:25:22.642811+0000","last_peered":"2026-02-13T01:25:22.642811+0000","last_clean":"2026-02-13T01:25:22.642811+0000","last_became_active":"2026-02-13T01:25:13.600958+0000","last_became_peered":"2026-02-13T01:25:13.600958+0000","last_unstale":"2026-02-13T01:25:22.642811+0000","last_undegraded":"2026-02-13T01:25:22.642811+0000","last_fullsized":"2026-02-13T01:25:22.642811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:15:12.659724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626383+0000","last_change":"2026-02-13T01:25:13.595002+0000","last_active":"2026-02-13T01:25:22.626383+0000","last_peered":"2026-02-13T01:25:22.626383+0000","last_clean":"2026-02-13T01:25:22.626383+0000","last_became_active":"2026-02-13T01:25:13.594709+0000","last_became_peered":"2026-02-13T01:25:13.594709+0000","last_unstale":"2026-02-13T01:25:22.626383+0000","last_undegraded":"2026-02-13T01:25:22.626383+0000","last_fullsized":"2026-02-13T01:25:22.626383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:42:01.732241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628063+0000","last_change":"2026-02-13T01:25:13.599426+0000","last_active":"2026-02-13T01:25:22.628063+0000","last_peered":"2026-02-13T01:25:22.628063+0000","last_clean":"2026-02-13T01:25:22.628063+0000","last_became_active":"2026-02-13T01:25:13.599121+0000","last_became_peered":"2026-02-13T01:25:13.599121+0000","last_unstale":"2026-02-13T01:25:22.628063+0000","last_undegraded":"2026-02-13T01:25:22.628063+0000","last_fullsized":"2026-02-13T01:25:22.628063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:43.625554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626618+0000","last_change":"2026-02-13T01:25:13.595569+0000","last_active":"2026-02-13T01:25:22.626618+0000","last_peered":"2026-02-13T01:25:22.626618+0000","last_clean":"2026-02-13T01:25:22.626618+0000","last_became_active":"2026-02-13T01:25:13.595429+0000","last_became_peered":"2026-02-13T01:25:13.595429+0000","last_unstale":"2026-02-13T01:25:22.626618+0000","last_undegraded":"2026-02-13T01:25:22.626618+0000","last_fullsized":"2026-02-13T01:25:22.626618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:03.129382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633164+0000","last_change":"2026-02-13T01:25:13.596331+0000","last_active":"2026-02-13T01:25:22.633164+0000","last_peered":"2026-02-13T01:25:22.633164+0000","last_clean":"2026-02-13T01:25:22.633164+0000","last_became_active":"2026-02-13T01:25:13.596110+0000","last_became_peered":"2026-02-13T01:25:13.596110+0000","last_unstale":"2026-02-13T01:25:22.633164+0000","last_undegraded":"2026-02-13T01:25:22.633164+0000","last_fullsized":"2026-02-13T01:25:22.633164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:48:05.074653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628509+0000","last_change":"2026-02-13T01:25:13.599783+0000","last_active":"2026-02-13T01:25:22.628509+0000","last_peered":"2026-02-13T01:25:22.628509+0000","last_clean":"2026-02-13T01:25:22.628509+0000","last_became_active":"2026-02-13T01:25:13.599599+0000","last_became_peered":"2026-02-13T01:25:13.599599+0000","last_unstale":"2026-02-13T01:25:22.628509+0000","last_undegraded":"2026-02-13T01:25:22.628509+0000","last_fullsized":"2026-02-13T01:25:22.628509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:50.944319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628522+0000","last_change":"2026-02-13T01:25:13.600374+0000","last_active":"2026-02-13T01:25:22.628522+0000","last_peered":"2026-02-13T01:25:22.628522+0000","last_clean":"2026-02-13T01:25:22.628522+0000","last_became_active":"2026-02-13T01:25:13.600257+0000","last_became_peered":"2026-02-13T01:25:13.600257+0000","last_unstale":"2026-02-13T01:25:22.628522+0000","last_undegraded":"2026-02-13T01:25:22.628522+0000","last_fullsized":"2026-02-13T01:25:22.628522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:53:52.750448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642493+0000","last_change":"2026-02-13T01:25:13.600258+0000","last_active":"2026-02-13T01:25:22.642493+0000","last_peered":"2026-02-13T01:25:22.642493+0000","last_clean":"2026-02-13T01:25:22.642493+0000","last_became_active":"2026-02-13T01:25:13.599763+0000","last_became_peered":"2026-02-13T01:25:13.599763+0000","last_unstale":"2026-02-13T01:25:22.642493+0000","last_undegraded":"2026-02-13T01:25:22.642493+0000","last_fullsized":"2026-02-13T01:25:22.642493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:36:19.768078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626940+0000","last_change":"2026-02-13T01:25:13.598638+0000","last_active":"2026-02-13T01:25:22.626940+0000","last_peered":"2026-02-13T01:25:22.626940+0000","last_clean":"2026-02-13T01:25:22.626940+0000","last_became_active":"2026-02-13T01:25:13.598461+0000","last_became_peered":"2026-02-13T01:25:13.598461+0000","last_unstale":"2026-02-13T01:25:22.626940+0000","last_undegraded":"2026-02-13T01:25:22.626940+0000","last_fullsized":"2026-02-13T01:25:22.626940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:01.237039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629211+0000","last_change":"2026-02-13T01:25:13.599839+0000","last_active":"2026-02-13T01:25:22.629211+0000","last_peered":"2026-02-13T01:25:22.629211+0000","last_clean":"2026-02-13T01:25:22.629211+0000","last_became_active":"2026-02-13T01:25:13.599737+0000","last_became_peered":"2026-02-13T01:25:13.599737+0000","last_unstale":"2026-02-13T01:25:22.629211+0000","last_undegraded":"2026-02-13T01:25:22.629211+0000","last_fullsized":"2026-02-13T01:25:22.629211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:20.073558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627207+0000","last_change":"2026-02-13T01:25:13.596751+0000","last_active":"2026-02-13T01:25:22.627207+0000","last_peered":"2026-02-13T01:25:22.627207+0000","last_clean":"2026-02-13T01:25:22.627207+0000","last_became_active":"2026-02-13T01:25:13.596474+0000","last_became_peered":"2026-02-13T01:25:13.596474+0000","last_unstale":"2026-02-13T01:25:22.627207+0000","last_undegraded":"2026-02-13T01:25:22.627207+0000","last_fullsized":"2026-02-13T01:25:22.627207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:56.315292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628087+0000","last_change":"2026-02-13T01:25:22.628052+0000","last_active":"2026-02-13T01:25:22.628087+0000","last_peered":"2026-02-13T01:25:22.628087+0000","last_clean":"2026-02-13T01:25:22.628087+0000","last_became_active":"2026-02-13T01:25:22.627937+0000","last_became_peered":"2026-02-13T01:25:22.627937+0000","last_unstale":"2026-02-13T01:25:22.628087+0000","last_undegraded":"2026-02-13T01:25:22.628087+0000","last_fullsized":"2026-02-13T01:25:22.628087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:06:22.940095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633212+0000","last_change":"2026-02-13T01:25:13.597356+0000","last_active":"2026-02-13T01:25:22.633212+0000","last_peered":"2026-02-13T01:25:22.633212+0000","last_clean":"2026-02-13T01:25:22.633212+0000","last_became_active":"2026-02-13T01:25:13.597245+0000","last_became_peered":"2026-02-13T01:25:13.597245+0000","last_unstale":"2026-02-13T01:25:22.633212+0000","last_undegraded":"2026-02-13T01:25:22.633212+0000","last_fullsized":"2026-02-13T01:25:22.633212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:58.602043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642683+0000","last_change":"2026-02-13T01:25:13.599295+0000","last_active":"2026-02-13T01:25:22.642683+0000","last_peered":"2026-02-13T01:25:22.642683+0000","last_clean":"2026-02-13T01:25:22.642683+0000","last_became_active":"2026-02-13T01:25:13.599011+0000","last_became_peered":"2026-02-13T01:25:13.599011+0000","last_unstale":"2026-02-13T01:25:22.642683+0000","last_undegraded":"2026-02-13T01:25:22.642683+0000","last_fullsized":"2026-02-13T01:25:22.642683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:03.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629747+0000","last_change":"2026-02-13T01:25:13.596927+0000","last_active":"2026-02-13T01:25:22.629747+0000","last_peered":"2026-02-13T01:25:22.629747+0000","last_clean":"2026-02-13T01:25:22.629747+0000","last_became_active":"2026-02-13T01:25:13.596694+0000","last_became_peered":"2026-02-13T01:25:13.596694+0000","last_unstale":"2026-02-13T01:25:22.629747+0000","last_undegraded":"2026-02-13T01:25:22.629747+0000","last_fullsized":"2026-02-13T01:25:22.629747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:12.958466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626456+0000","last_change":"2026-02-13T01:25:13.597186+0000","last_active":"2026-02-13T01:25:22.626456+0000","last_peered":"2026-02-13T01:25:22.626456+0000","last_clean":"2026-02-13T01:25:22.626456+0000","last_became_active":"2026-02-13T01:25:13.596845+0000","last_became_peered":"2026-02-13T01:25:13.596845+0000","last_unstale":"2026-02-13T01:25:22.626456+0000","last_undegraded":"2026-02-13T01:25:22.626456+0000","last_fullsized":"2026-02-13T01:25:22.626456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:50:15.787511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630142+0000","last_change":"2026-02-13T01:25:13.598968+0000","last_active":"2026-02-13T01:25:22.630142+0000","last_peered":"2026-02-13T01:25:22.630142+0000","last_clean":"2026-02-13T01:25:22.630142+0000","last_became_active":"2026-02-13T01:25:13.598579+0000","last_became_peered":"2026-02-13T01:25:13.598579+0000","last_unstale":"2026-02-13T01:25:22.630142+0000","last_undegraded":"2026-02-13T01:25:22.630142+0000","last_fullsized":"2026-02-13T01:25:22.630142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:45:49.051626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627400+0000","last_change":"2026-02-13T01:25:13.598068+0000","last_active":"2026-02-13T01:25:22.627400+0000","last_peered":"2026-02-13T01:25:22.627400+0000","last_clean":"2026-02-13T01:25:22.627400+0000","last_became_active":"2026-02-13T01:25:13.597724+0000","last_became_peered":"2026-02-13T01:25:13.597724+0000","last_unstale":"2026-02-13T01:25:22.627400+0000","last_undegraded":"2026-02-13T01:25:22.627400+0000","last_fullsized":"2026-02-13T01:25:22.627400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:48.542392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626633+0000","last_change":"2026-02-13T01:25:13.594807+0000","last_active":"2026-02-13T01:25:22.626633+0000","last_peered":"2026-02-13T01:25:22.626633+0000","last_clean":"2026-02-13T01:25:22.626633+0000","last_became_active":"2026-02-13T01:25:13.594367+0000","last_became_peered":"2026-02-13T01:25:13.594367+0000","last_unstale":"2026-02-13T01:25:22.626633+0000","last_undegraded":"2026-02-13T01:25:22.626633+0000","last_fullsized":"2026-02-13T01:25:22.626633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:03.116695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633246+0000","last_change":"2026-02-13T01:25:13.595823+0000","last_active":"2026-02-13T01:25:22.633246+0000","last_peered":"2026-02-13T01:25:22.633246+0000","last_clean":"2026-02-13T01:25:22.633246+0000","last_became_active":"2026-02-13T01:25:13.595587+0000","last_became_peered":"2026-02-13T01:25:13.595587+0000","last_unstale":"2026-02-13T01:25:22.633246+0000","last_undegraded":"2026-02-13T01:25:22.633246+0000","last_fullsized":"2026-02-13T01:25:22.633246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:57:11.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633527+0000","last_change":"2026-02-13T01:25:22.633482+0000","last_active":"2026-02-13T01:25:22.633527+0000","last_peered":"2026-02-13T01:25:22.633527+0000","last_clean":"2026-02-13T01:25:22.633527+0000","last_became_active":"2026-02-13T01:25:22.633319+0000","last_became_peered":"2026-02-13T01:25:22.633319+0000","last_unstale":"2026-02-13T01:25:22.633527+0000","last_undegraded":"2026-02-13T01:25:22.633527+0000","last_fullsized":"2026-02-13T01:25:22.633527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:59:14.570108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627201+0000","last_change":"2026-02-13T01:25:13.596471+0000","last_active":"2026-02-13T01:25:22.627201+0000","last_peered":"2026-02-13T01:25:22.627201+0000","last_clean":"2026-02-13T01:25:22.627201+0000","last_became_active":"2026-02-13T01:25:13.596238+0000","last_became_peered":"2026-02-13T01:25:13.596238+0000","last_unstale":"2026-02-13T01:25:22.627201+0000","last_undegraded":"2026-02-13T01:25:22.627201+0000","last_fullsized":"2026-02-13T01:25:22.627201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:05:24.893159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627215+0000","last_change":"2026-02-13T01:25:13.597034+0000","last_active":"2026-02-13T01:25:22.627215+0000","last_peered":"2026-02-13T01:25:22.627215+0000","last_clean":"2026-02-13T01:25:22.627215+0000","last_became_active":"2026-02-13T01:25:13.596573+0000","last_became_peered":"2026-02-13T01:25:13.596573+0000","last_unstale":"2026-02-13T01:25:22.627215+0000","last_undegraded":"2026-02-13T01:25:22.627215+0000","last_fullsized":"2026-02-13T01:25:22.627215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:49:51.020546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626519+0000","last_change":"2026-02-13T01:25:13.594615+0000","last_active":"2026-02-13T01:25:22.626519+0000","last_peered":"2026-02-13T01:25:22.626519+0000","last_clean":"2026-02-13T01:25:22.626519+0000","last_became_active":"2026-02-13T01:25:13.594349+0000","last_became_peered":"2026-02-13T01:25:13.594349+0000","last_unstale":"2026-02-13T01:25:22.626519+0000","last_undegraded":"2026-02-13T01:25:22.626519+0000","last_fullsized":"2026-02-13T01:25:22.626519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:03.697709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625856+0000","last_change":"2026-02-13T01:25:13.595949+0000","last_active":"2026-02-13T01:25:22.625856+0000","last_peered":"2026-02-13T01:25:22.625856+0000","last_clean":"2026-02-13T01:25:22.625856+0000","last_became_active":"2026-02-13T01:25:13.595183+0000","last_became_peered":"2026-02-13T01:25:13.595183+0000","last_unstale":"2026-02-13T01:25:22.625856+0000","last_undegraded":"2026-02-13T01:25:22.625856+0000","last_fullsized":"2026-02-13T01:25:22.625856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:36.191774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.606322+0000","last_change":"2026-02-13T01:25:12.586512+0000","last_active":"2026-02-13T01:25:24.606322+0000","last_peered":"2026-02-13T01:25:24.606322+0000","last_clean":"2026-02-13T01:25:24.606322+0000","last_became_active":"2026-02-13T01:25:12.586332+0000","last_became_peered":"2026-02-13T01:25:12.586332+0000","last_unstale":"2026-02-13T01:25:24.606322+0000","last_undegraded":"2026-02-13T01:25:24.606322+0000","last_fullsized":"2026-02-13T01:25:24.606322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:04.971228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626532+0000","last_change":"2026-02-13T01:25:13.596348+0000","last_active":"2026-02-13T01:25:22.626532+0000","last_peered":"2026-02-13T01:25:22.626532+0000","last_clean":"2026-02-13T01:25:22.626532+0000","last_became_active":"2026-02-13T01:25:13.596143+0000","last_became_peered":"2026-02-13T01:25:13.596143+0000","last_unstale":"2026-02-13T01:25:22.626532+0000","last_undegraded":"2026-02-13T01:25:22.626532+0000","last_fullsized":"2026-02-13T01:25:22.626532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:49:34.818946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626172+0000","last_change":"2026-02-13T01:25:12.583872+0000","last_active":"2026-02-13T01:25:22.626172+0000","last_peered":"2026-02-13T01:25:22.626172+0000","last_clean":"2026-02-13T01:25:22.626172+0000","last_became_active":"2026-02-13T01:25:12.583688+0000","last_became_peered":"2026-02-13T01:25:12.583688+0000","last_unstale":"2026-02-13T01:25:22.626172+0000","last_undegraded":"2026-02-13T01:25:22.626172+0000","last_fullsized":"2026-02-13T01:25:22.626172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:24:57.991039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633044+0000","last_change":"2026-02-13T01:25:12.585552+0000","last_active":"2026-02-13T01:25:22.633044+0000","last_peered":"2026-02-13T01:25:22.633044+0000","last_clean":"2026-02-13T01:25:22.633044+0000","last_became_active":"2026-02-13T01:25:12.585237+0000","last_became_peered":"2026-02-13T01:25:12.585237+0000","last_unstale":"2026-02-13T01:25:22.633044+0000","last_undegraded":"2026-02-13T01:25:22.633044+0000","last_fullsized":"2026-02-13T01:25:22.633044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:48.661981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629768+0000","last_change":"2026-02-13T01:25:13.597739+0000","last_active":"2026-02-13T01:25:22.629768+0000","last_peered":"2026-02-13T01:25:22.629768+0000","last_clean":"2026-02-13T01:25:22.629768+0000","last_became_active":"2026-02-13T01:25:13.597579+0000","last_became_peered":"2026-02-13T01:25:13.597579+0000","last_unstale":"2026-02-13T01:25:22.629768+0000","last_undegraded":"2026-02-13T01:25:22.629768+0000","last_fullsized":"2026-02-13T01:25:22.629768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:34:45.020931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626750+0000","last_change":"2026-02-13T01:25:12.586197+0000","last_active":"2026-02-13T01:25:22.626750+0000","last_peered":"2026-02-13T01:25:22.626750+0000","last_clean":"2026-02-13T01:25:22.626750+0000","last_became_active":"2026-02-13T01:25:12.585596+0000","last_became_peered":"2026-02-13T01:25:12.585596+0000","last_unstale":"2026-02-13T01:25:22.626750+0000","last_undegraded":"2026-02-13T01:25:22.626750+0000","last_fullsized":"2026-02-13T01:25:22.626750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:43:32.118426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628933+0000","last_change":"2026-02-13T01:25:13.597729+0000","last_active":"2026-02-13T01:25:22.628933+0000","last_peered":"2026-02-13T01:25:22.628933+0000","last_clean":"2026-02-13T01:25:22.628933+0000","last_became_active":"2026-02-13T01:25:13.597613+0000","last_became_peered":"2026-02-13T01:25:13.597613+0000","last_unstale":"2026-02-13T01:25:22.628933+0000","last_undegraded":"2026-02-13T01:25:22.628933+0000","last_fullsized":"2026-02-13T01:25:22.628933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:55:31.684388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.606855+0000","last_change":"2026-02-13T01:25:12.586878+0000","last_active":"2026-02-13T01:25:24.606855+0000","last_peered":"2026-02-13T01:25:24.606855+0000","last_clean":"2026-02-13T01:25:24.606855+0000","last_became_active":"2026-02-13T01:25:12.586734+0000","last_became_peered":"2026-02-13T01:25:12.586734+0000","last_unstale":"2026-02-13T01:25:24.606855+0000","last_undegraded":"2026-02-13T01:25:24.606855+0000","last_fullsized":"2026-02-13T01:25:24.606855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:29:16.007641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642709+0000","last_change":"2026-02-13T01:25:13.599851+0000","last_active":"2026-02-13T01:25:22.642709+0000","last_peered":"2026-02-13T01:25:22.642709+0000","last_clean":"2026-02-13T01:25:22.642709+0000","last_became_active":"2026-02-13T01:25:13.599378+0000","last_became_peered":"2026-02-13T01:25:13.599378+0000","last_unstale":"2026-02-13T01:25:22.642709+0000","last_undegraded":"2026-02-13T01:25:22.642709+0000","last_fullsized":"2026-02-13T01:25:22.642709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:17.930220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628060+0000","last_change":"2026-02-13T01:25:12.586174+0000","last_active":"2026-02-13T01:25:22.628060+0000","last_peered":"2026-02-13T01:25:22.628060+0000","last_clean":"2026-02-13T01:25:22.628060+0000","last_became_active":"2026-02-13T01:25:12.585898+0000","last_became_peered":"2026-02-13T01:25:12.585898+0000","last_unstale":"2026-02-13T01:25:22.628060+0000","last_undegraded":"2026-02-13T01:25:22.628060+0000","last_fullsized":"2026-02-13T01:25:22.628060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:50:48.499836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628981+0000","last_change":"2026-02-13T01:25:13.599679+0000","last_active":"2026-02-13T01:25:22.628981+0000","last_peered":"2026-02-13T01:25:22.628981+0000","last_clean":"2026-02-13T01:25:22.628981+0000","last_became_active":"2026-02-13T01:25:13.599505+0000","last_became_peered":"2026-02-13T01:25:13.599505+0000","last_unstale":"2026-02-13T01:25:22.628981+0000","last_undegraded":"2026-02-13T01:25:22.628981+0000","last_fullsized":"2026-02-13T01:25:22.628981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:20:55.098705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626760+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:22.626760+0000","last_peered":"2026-02-13T01:25:22.626760+0000","last_clean":"2026-02-13T01:25:22.626760+0000","last_became_active":"2026-02-13T01:25:12.584983+0000","last_became_peered":"2026-02-13T01:25:12.584983+0000","last_unstale":"2026-02-13T01:25:22.626760+0000","last_undegraded":"2026-02-13T01:25:22.626760+0000","last_fullsized":"2026-02-13T01:25:22.626760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:19:34.247623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642698+0000","last_change":"2026-02-13T01:25:13.600875+0000","last_active":"2026-02-13T01:25:22.642698+0000","last_peered":"2026-02-13T01:25:22.642698+0000","last_clean":"2026-02-13T01:25:22.642698+0000","last_became_active":"2026-02-13T01:25:13.600022+0000","last_became_peered":"2026-02-13T01:25:13.600022+0000","last_unstale":"2026-02-13T01:25:22.642698+0000","last_undegraded":"2026-02-13T01:25:22.642698+0000","last_fullsized":"2026-02-13T01:25:22.642698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:12.241807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'24","reported_seq":63,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.610254+0000","last_change":"2026-02-13T01:25:12.585602+0000","last_active":"2026-02-13T01:25:24.610254+0000","last_peered":"2026-02-13T01:25:24.610254+0000","last_clean":"2026-02-13T01:25:24.610254+0000","last_became_active":"2026-02-13T01:25:12.585421+0000","last_became_peered":"2026-02-13T01:25:12.585421+0000","last_unstale":"2026-02-13T01:25:24.610254+0000","last_undegraded":"2026-02-13T01:25:24.610254+0000","last_fullsized":"2026-02-13T01:25:24.610254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:42.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":61,"num_write":26,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626023+0000","last_change":"2026-02-13T01:25:13.595983+0000","last_active":"2026-02-13T01:25:22.626023+0000","last_peered":"2026-02-13T01:25:22.626023+0000","last_clean":"2026-02-13T01:25:22.626023+0000","last_became_active":"2026-02-13T01:25:13.594518+0000","last_became_peered":"2026-02-13T01:25:13.594518+0000","last_unstale":"2026-02-13T01:25:22.626023+0000","last_undegraded":"2026-02-13T01:25:22.626023+0000","last_fullsized":"2026-02-13T01:25:22.626023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:16.951050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627439+0000","last_change":"2026-02-13T01:25:12.585520+0000","last_active":"2026-02-13T01:25:22.627439+0000","last_peered":"2026-02-13T01:25:22.627439+0000","last_clean":"2026-02-13T01:25:22.627439+0000","last_became_active":"2026-02-13T01:25:12.584720+0000","last_became_peered":"2026-02-13T01:25:12.584720+0000","last_unstale":"2026-02-13T01:25:22.627439+0000","last_undegraded":"2026-02-13T01:25:22.627439+0000","last_fullsized":"2026-02-13T01:25:22.627439+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:52.811064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633065+0000","last_change":"2026-02-13T01:25:13.597736+0000","last_active":"2026-02-13T01:25:22.633065+0000","last_peered":"2026-02-13T01:25:22.633065+0000","last_clean":"2026-02-13T01:25:22.633065+0000","last_became_active":"2026-02-13T01:25:13.597635+0000","last_became_peered":"2026-02-13T01:25:13.597635+0000","last_unstale":"2026-02-13T01:25:22.633065+0000","last_undegraded":"2026-02-13T01:25:22.633065+0000","last_fullsized":"2026-02-13T01:25:22.633065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:09.718614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626494+0000","last_change":"2026-02-13T01:25:12.585611+0000","last_active":"2026-02-13T01:25:22.626494+0000","last_peered":"2026-02-13T01:25:22.626494+0000","last_clean":"2026-02-13T01:25:22.626494+0000","last_became_active":"2026-02-13T01:25:12.585213+0000","last_became_peered":"2026-02-13T01:25:12.585213+0000","last_unstale":"2026-02-13T01:25:22.626494+0000","last_undegraded":"2026-02-13T01:25:22.626494+0000","last_fullsized":"2026-02-13T01:25:22.626494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:58.518168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628110+0000","last_change":"2026-02-13T01:25:13.596481+0000","last_active":"2026-02-13T01:25:22.628110+0000","last_peered":"2026-02-13T01:25:22.628110+0000","last_clean":"2026-02-13T01:25:22.628110+0000","last_became_active":"2026-02-13T01:25:13.596188+0000","last_became_peered":"2026-02-13T01:25:13.596188+0000","last_unstale":"2026-02-13T01:25:22.628110+0000","last_undegraded":"2026-02-13T01:25:22.628110+0000","last_fullsized":"2026-02-13T01:25:22.628110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:31.070201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.608400+0000","last_change":"2026-02-13T01:25:12.585557+0000","last_active":"2026-02-13T01:25:23.608400+0000","last_peered":"2026-02-13T01:25:23.608400+0000","last_clean":"2026-02-13T01:25:23.608400+0000","last_became_active":"2026-02-13T01:25:12.585406+0000","last_became_peered":"2026-02-13T01:25:12.585406+0000","last_unstale":"2026-02-13T01:25:23.608400+0000","last_undegraded":"2026-02-13T01:25:23.608400+0000","last_fullsized":"2026-02-13T01:25:23.608400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:27.444543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627826+0000","last_change":"2026-02-13T01:25:13.596633+0000","last_active":"2026-02-13T01:25:22.627826+0000","last_peered":"2026-02-13T01:25:22.627826+0000","last_clean":"2026-02-13T01:25:22.627826+0000","last_became_active":"2026-02-13T01:25:13.596408+0000","last_became_peered":"2026-02-13T01:25:13.596408+0000","last_unstale":"2026-02-13T01:25:22.627826+0000","last_undegraded":"2026-02-13T01:25:22.627826+0000","last_fullsized":"2026-02-13T01:25:22.627826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:04:43.368134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625610+0000","last_change":"2026-02-13T01:25:12.585798+0000","last_active":"2026-02-13T01:25:22.625610+0000","last_peered":"2026-02-13T01:25:22.625610+0000","last_clean":"2026-02-13T01:25:22.625610+0000","last_became_active":"2026-02-13T01:25:12.585641+0000","last_became_peered":"2026-02-13T01:25:12.585641+0000","last_unstale":"2026-02-13T01:25:22.625610+0000","last_undegraded":"2026-02-13T01:25:22.625610+0000","last_fullsized":"2026-02-13T01:25:22.625610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:16:39.636368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.644045+0000","last_change":"2026-02-13T01:25:22.643876+0000","last_active":"2026-02-13T01:25:22.644045+0000","last_peered":"2026-02-13T01:25:22.644045+0000","last_clean":"2026-02-13T01:25:22.644045+0000","last_became_active":"2026-02-13T01:25:22.643738+0000","last_became_peered":"2026-02-13T01:25:22.643738+0000","last_unstale":"2026-02-13T01:25:22.644045+0000","last_undegraded":"2026-02-13T01:25:22.644045+0000","last_fullsized":"2026-02-13T01:25:22.644045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:39.300474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626122+0000","last_change":"2026-02-13T01:25:12.585124+0000","last_active":"2026-02-13T01:25:22.626122+0000","last_peered":"2026-02-13T01:25:22.626122+0000","last_clean":"2026-02-13T01:25:22.626122+0000","last_became_active":"2026-02-13T01:25:12.584899+0000","last_became_peered":"2026-02-13T01:25:12.584899+0000","last_unstale":"2026-02-13T01:25:22.626122+0000","last_undegraded":"2026-02-13T01:25:22.626122+0000","last_fullsized":"2026-02-13T01:25:22.626122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:20.160445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626690+0000","last_change":"2026-02-13T01:25:13.594139+0000","last_active":"2026-02-13T01:25:22.626690+0000","last_peered":"2026-02-13T01:25:22.626690+0000","last_clean":"2026-02-13T01:25:22.626690+0000","last_became_active":"2026-02-13T01:25:13.593871+0000","last_became_peered":"2026-02-13T01:25:13.593871+0000","last_unstale":"2026-02-13T01:25:22.626690+0000","last_undegraded":"2026-02-13T01:25:22.626690+0000","last_fullsized":"2026-02-13T01:25:22.626690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:27.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633282+0000","last_change":"2026-02-13T01:25:12.587190+0000","last_active":"2026-02-13T01:25:22.633282+0000","last_peered":"2026-02-13T01:25:22.633282+0000","last_clean":"2026-02-13T01:25:22.633282+0000","last_became_active":"2026-02-13T01:25:12.586934+0000","last_became_peered":"2026-02-13T01:25:12.586934+0000","last_unstale":"2026-02-13T01:25:22.633282+0000","last_undegraded":"2026-02-13T01:25:22.633282+0000","last_fullsized":"2026-02-13T01:25:22.633282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:59.367266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628158+0000","last_change":"2026-02-13T01:25:13.597938+0000","last_active":"2026-02-13T01:25:22.628158+0000","last_peered":"2026-02-13T01:25:22.628158+0000","last_clean":"2026-02-13T01:25:22.628158+0000","last_became_active":"2026-02-13T01:25:13.597812+0000","last_became_peered":"2026-02-13T01:25:13.597812+0000","last_unstale":"2026-02-13T01:25:22.628158+0000","last_undegraded":"2026-02-13T01:25:22.628158+0000","last_fullsized":"2026-02-13T01:25:22.628158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:13.982549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626739+0000","last_change":"2026-02-13T01:25:12.585792+0000","last_active":"2026-02-13T01:25:22.626739+0000","last_peered":"2026-02-13T01:25:22.626739+0000","last_clean":"2026-02-13T01:25:22.626739+0000","last_became_active":"2026-02-13T01:25:12.584980+0000","last_became_peered":"2026-02-13T01:25:12.584980+0000","last_unstale":"2026-02-13T01:25:22.626739+0000","last_undegraded":"2026-02-13T01:25:22.626739+0000","last_fullsized":"2026-02-13T01:25:22.626739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:44.806719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628021+0000","last_change":"2026-02-13T01:25:13.597068+0000","last_active":"2026-02-13T01:25:22.628021+0000","last_peered":"2026-02-13T01:25:22.628021+0000","last_clean":"2026-02-13T01:25:22.628021+0000","last_became_active":"2026-02-13T01:25:13.596764+0000","last_became_peered":"2026-02-13T01:25:13.596764+0000","last_unstale":"2026-02-13T01:25:22.628021+0000","last_undegraded":"2026-02-13T01:25:22.628021+0000","last_fullsized":"2026-02-13T01:25:22.628021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:04.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.616434+0000","last_change":"2026-02-13T01:25:12.587494+0000","last_active":"2026-02-13T01:25:23.616434+0000","last_peered":"2026-02-13T01:25:23.616434+0000","last_clean":"2026-02-13T01:25:23.616434+0000","last_became_active":"2026-02-13T01:25:12.587302+0000","last_became_peered":"2026-02-13T01:25:12.587302+0000","last_unstale":"2026-02-13T01:25:23.616434+0000","last_undegraded":"2026-02-13T01:25:23.616434+0000","last_fullsized":"2026-02-13T01:25:23.616434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:35.215432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628114+0000","last_change":"2026-02-13T01:25:13.599446+0000","last_active":"2026-02-13T01:25:22.628114+0000","last_peered":"2026-02-13T01:25:22.628114+0000","last_clean":"2026-02-13T01:25:22.628114+0000","last_became_active":"2026-02-13T01:25:13.599198+0000","last_became_peered":"2026-02-13T01:25:13.599198+0000","last_unstale":"2026-02-13T01:25:22.628114+0000","last_undegraded":"2026-02-13T01:25:22.628114+0000","last_fullsized":"2026-02-13T01:25:22.628114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:43.435619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":351,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627970+0000","last_change":"2026-02-13T01:24:51.184559+0000","last_active":"2026-02-13T01:25:22.627970+0000","last_peered":"2026-02-13T01:25:22.627970+0000","last_clean":"2026-02-13T01:25:22.627970+0000","last_became_active":"2026-02-13T01:24:51.184384+0000","last_became_peered":"2026-02-13T01:24:51.184384+0000","last_unstale":"2026-02-13T01:25:22.627970+0000","last_undegraded":"2026-02-13T01:25:22.627970+0000","last_fullsized":"2026-02-13T01:25:22.627970+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_clean_scrub_stamp":"2026-02-13T01:23:51.893115+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:29.993013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626593+0000","last_change":"2026-02-13T01:25:12.585065+0000","last_active":"2026-02-13T01:25:22.626593+0000","last_peered":"2026-02-13T01:25:22.626593+0000","last_clean":"2026-02-13T01:25:22.626593+0000","last_became_active":"2026-02-13T01:25:12.584714+0000","last_became_peered":"2026-02-13T01:25:12.584714+0000","last_unstale":"2026-02-13T01:25:22.626593+0000","last_undegraded":"2026-02-13T01:25:22.626593+0000","last_fullsized":"2026-02-13T01:25:22.626593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:38.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630001+0000","last_change":"2026-02-13T01:25:13.600026+0000","last_active":"2026-02-13T01:25:22.630001+0000","last_peered":"2026-02-13T01:25:22.630001+0000","last_clean":"2026-02-13T01:25:22.630001+0000","last_became_active":"2026-02-13T01:25:13.599911+0000","last_became_peered":"2026-02-13T01:25:13.599911+0000","last_unstale":"2026-02-13T01:25:22.630001+0000","last_undegraded":"2026-02-13T01:25:22.630001+0000","last_fullsized":"2026-02-13T01:25:22.630001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:32.272988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627946+0000","last_change":"2026-02-13T01:25:12.586863+0000","last_active":"2026-02-13T01:25:22.627946+0000","last_peered":"2026-02-13T01:25:22.627946+0000","last_clean":"2026-02-13T01:25:22.627946+0000","last_became_active":"2026-02-13T01:25:12.586695+0000","last_became_peered":"2026-02-13T01:25:12.586695+0000","last_unstale":"2026-02-13T01:25:22.627946+0000","last_undegraded":"2026-02-13T01:25:22.627946+0000","last_fullsized":"2026-02-13T01:25:22.627946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:32.822119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633026+0000","last_change":"2026-02-13T01:25:13.596332+0000","last_active":"2026-02-13T01:25:22.633026+0000","last_peered":"2026-02-13T01:25:22.633026+0000","last_clean":"2026-02-13T01:25:22.633026+0000","last_became_active":"2026-02-13T01:25:13.596177+0000","last_became_peered":"2026-02-13T01:25:13.596177+0000","last_unstale":"2026-02-13T01:25:22.633026+0000","last_undegraded":"2026-02-13T01:25:22.633026+0000","last_fullsized":"2026-02-13T01:25:22.633026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:12.653773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.609120+0000","last_change":"2026-02-13T01:25:12.584951+0000","last_active":"2026-02-13T01:25:23.609120+0000","last_peered":"2026-02-13T01:25:23.609120+0000","last_clean":"2026-02-13T01:25:23.609120+0000","last_became_active":"2026-02-13T01:25:12.584782+0000","last_became_peered":"2026-02-13T01:25:12.584782+0000","last_unstale":"2026-02-13T01:25:23.609120+0000","last_undegraded":"2026-02-13T01:25:23.609120+0000","last_fullsized":"2026-02-13T01:25:23.609120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:50:10.145512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.631966+0000","last_change":"2026-02-13T01:25:22.631932+0000","last_active":"2026-02-13T01:25:22.631966+0000","last_peered":"2026-02-13T01:25:22.631966+0000","last_clean":"2026-02-13T01:25:22.631966+0000","last_became_active":"2026-02-13T01:25:22.631743+0000","last_became_peered":"2026-02-13T01:25:22.631743+0000","last_unstale":"2026-02-13T01:25:22.631966+0000","last_undegraded":"2026-02-13T01:25:22.631966+0000","last_fullsized":"2026-02-13T01:25:22.631966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:57.457542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.630465+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:24.630465+0000","last_peered":"2026-02-13T01:25:24.630465+0000","last_clean":"2026-02-13T01:25:24.630465+0000","last_became_active":"2026-02-13T01:25:12.584995+0000","last_became_peered":"2026-02-13T01:25:12.584995+0000","last_unstale":"2026-02-13T01:25:24.630465+0000","last_undegraded":"2026-02-13T01:25:24.630465+0000","last_fullsized":"2026-02-13T01:25:24.630465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:26.521420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626306+0000","last_change":"2026-02-13T01:25:13.599307+0000","last_active":"2026-02-13T01:25:22.626306+0000","last_peered":"2026-02-13T01:25:22.626306+0000","last_clean":"2026-02-13T01:25:22.626306+0000","last_became_active":"2026-02-13T01:25:13.599019+0000","last_became_peered":"2026-02-13T01:25:13.599019+0000","last_unstale":"2026-02-13T01:25:22.626306+0000","last_undegraded":"2026-02-13T01:25:22.626306+0000","last_fullsized":"2026-02-13T01:25:22.626306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:39.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.632006+0000","last_change":"2026-02-13T01:25:22.631969+0000","last_active":"2026-02-13T01:25:22.632006+0000","last_peered":"2026-02-13T01:25:22.632006+0000","last_clean":"2026-02-13T01:25:22.632006+0000","last_became_active":"2026-02-13T01:25:22.631746+0000","last_became_peered":"2026-02-13T01:25:22.631746+0000","last_unstale":"2026-02-13T01:25:22.632006+0000","last_undegraded":"2026-02-13T01:25:22.632006+0000","last_fullsized":"2026-02-13T01:25:22.632006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:41:38.492885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626295+0000","last_change":"2026-02-13T01:25:13.599386+0000","last_active":"2026-02-13T01:25:22.626295+0000","last_peered":"2026-02-13T01:25:22.626295+0000","last_clean":"2026-02-13T01:25:22.626295+0000","last_became_active":"2026-02-13T01:25:13.598797+0000","last_became_peered":"2026-02-13T01:25:13.598797+0000","last_unstale":"2026-02-13T01:25:22.626295+0000","last_undegraded":"2026-02-13T01:25:22.626295+0000","last_fullsized":"2026-02-13T01:25:22.626295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:47:41.920834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626122+0000","last_change":"2026-02-13T01:25:12.584149+0000","last_active":"2026-02-13T01:25:22.626122+0000","last_peered":"2026-02-13T01:25:22.626122+0000","last_clean":"2026-02-13T01:25:22.626122+0000","last_became_active":"2026-02-13T01:25:12.583192+0000","last_became_peered":"2026-02-13T01:25:12.583192+0000","last_unstale":"2026-02-13T01:25:22.626122+0000","last_undegraded":"2026-02-13T01:25:22.626122+0000","last_fullsized":"2026-02-13T01:25:22.626122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:49.438788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633306+0000","last_change":"2026-02-13T01:25:13.596354+0000","last_active":"2026-02-13T01:25:22.633306+0000","last_peered":"2026-02-13T01:25:22.633306+0000","last_clean":"2026-02-13T01:25:22.633306+0000","last_became_active":"2026-02-13T01:25:13.596192+0000","last_became_peered":"2026-02-13T01:25:13.596192+0000","last_unstale":"2026-02-13T01:25:22.633306+0000","last_undegraded":"2026-02-13T01:25:22.633306+0000","last_fullsized":"2026-02-13T01:25:22.633306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:39:38.836223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629301+0000","last_change":"2026-02-13T01:25:12.588331+0000","last_active":"2026-02-13T01:25:22.629301+0000","last_peered":"2026-02-13T01:25:22.629301+0000","last_clean":"2026-02-13T01:25:22.629301+0000","last_became_active":"2026-02-13T01:25:12.588071+0000","last_became_peered":"2026-02-13T01:25:12.588071+0000","last_unstale":"2026-02-13T01:25:22.629301+0000","last_undegraded":"2026-02-13T01:25:22.629301+0000","last_fullsized":"2026-02-13T01:25:22.629301+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:35.866770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630136+0000","last_change":"2026-02-13T01:25:13.598530+0000","last_active":"2026-02-13T01:25:22.630136+0000","last_peered":"2026-02-13T01:25:22.630136+0000","last_clean":"2026-02-13T01:25:22.630136+0000","last_became_active":"2026-02-13T01:25:13.598219+0000","last_became_peered":"2026-02-13T01:25:13.598219+0000","last_unstale":"2026-02-13T01:25:22.630136+0000","last_undegraded":"2026-02-13T01:25:22.630136+0000","last_fullsized":"2026-02-13T01:25:22.630136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:28:20.723555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626543+0000","last_change":"2026-02-13T01:25:12.588841+0000","last_active":"2026-02-13T01:25:22.626543+0000","last_peered":"2026-02-13T01:25:22.626543+0000","last_clean":"2026-02-13T01:25:22.626543+0000","last_became_active":"2026-02-13T01:25:12.588740+0000","last_became_peered":"2026-02-13T01:25:12.588740+0000","last_unstale":"2026-02-13T01:25:22.626543+0000","last_undegraded":"2026-02-13T01:25:22.626543+0000","last_fullsized":"2026-02-13T01:25:22.626543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:24.749019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628971+0000","last_change":"2026-02-13T01:25:13.599374+0000","last_active":"2026-02-13T01:25:22.628971+0000","last_peered":"2026-02-13T01:25:22.628971+0000","last_clean":"2026-02-13T01:25:22.628971+0000","last_became_active":"2026-02-13T01:25:13.599203+0000","last_became_peered":"2026-02-13T01:25:13.599203+0000","last_unstale":"2026-02-13T01:25:22.628971+0000","last_undegraded":"2026-02-13T01:25:22.628971+0000","last_fullsized":"2026-02-13T01:25:22.628971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.788063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642589+0000","last_change":"2026-02-13T01:25:12.586929+0000","last_active":"2026-02-13T01:25:22.642589+0000","last_peered":"2026-02-13T01:25:22.642589+0000","last_clean":"2026-02-13T01:25:22.642589+0000","last_became_active":"2026-02-13T01:25:12.586784+0000","last_became_peered":"2026-02-13T01:25:12.586784+0000","last_unstale":"2026-02-13T01:25:22.642589+0000","last_undegraded":"2026-02-13T01:25:22.642589+0000","last_fullsized":"2026-02-13T01:25:22.642589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:42.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625620+0000","last_change":"2026-02-13T01:25:13.595662+0000","last_active":"2026-02-13T01:25:22.625620+0000","last_peered":"2026-02-13T01:25:22.625620+0000","last_clean":"2026-02-13T01:25:22.625620+0000","last_became_active":"2026-02-13T01:25:13.595175+0000","last_became_peered":"2026-02-13T01:25:13.595175+0000","last_unstale":"2026-02-13T01:25:22.625620+0000","last_undegraded":"2026-02-13T01:25:22.625620+0000","last_fullsized":"2026-02-13T01:25:22.625620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:55.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629894+0000","last_change":"2026-02-13T01:25:12.585367+0000","last_active":"2026-02-13T01:25:22.629894+0000","last_peered":"2026-02-13T01:25:22.629894+0000","last_clean":"2026-02-13T01:25:22.629894+0000","last_became_active":"2026-02-13T01:25:12.585130+0000","last_became_peered":"2026-02-13T01:25:12.585130+0000","last_unstale":"2026-02-13T01:25:22.629894+0000","last_undegraded":"2026-02-13T01:25:22.629894+0000","last_fullsized":"2026-02-13T01:25:22.629894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:40.260699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626549+0000","last_change":"2026-02-13T01:25:13.595087+0000","last_active":"2026-02-13T01:25:22.626549+0000","last_peered":"2026-02-13T01:25:22.626549+0000","last_clean":"2026-02-13T01:25:22.626549+0000","last_became_active":"2026-02-13T01:25:13.594916+0000","last_became_peered":"2026-02-13T01:25:13.594916+0000","last_unstale":"2026-02-13T01:25:22.626549+0000","last_undegraded":"2026-02-13T01:25:22.626549+0000","last_fullsized":"2026-02-13T01:25:22.626549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:22:33.449950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630333+0000","last_change":"2026-02-13T01:25:22.630139+0000","last_active":"2026-02-13T01:25:22.630333+0000","last_peered":"2026-02-13T01:25:22.630333+0000","last_clean":"2026-02-13T01:25:22.630333+0000","last_became_active":"2026-02-13T01:25:22.628480+0000","last_became_peered":"2026-02-13T01:25:22.628480+0000","last_unstale":"2026-02-13T01:25:22.630333+0000","last_undegraded":"2026-02-13T01:25:22.630333+0000","last_fullsized":"2026-02-13T01:25:22.630333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:26:56.853898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629898+0000","last_change":"2026-02-13T01:25:13.597108+0000","last_active":"2026-02-13T01:25:22.629898+0000","last_peered":"2026-02-13T01:25:22.629898+0000","last_clean":"2026-02-13T01:25:22.629898+0000","last_became_active":"2026-02-13T01:25:13.596931+0000","last_became_peered":"2026-02-13T01:25:13.596931+0000","last_unstale":"2026-02-13T01:25:22.629898+0000","last_undegraded":"2026-02-13T01:25:22.629898+0000","last_fullsized":"2026-02-13T01:25:22.629898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:17:57.428194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.643886+0000","last_change":"2026-02-13T01:25:22.643859+0000","last_active":"2026-02-13T01:25:22.643886+0000","last_peered":"2026-02-13T01:25:22.643886+0000","last_clean":"2026-02-13T01:25:22.643886+0000","last_became_active":"2026-02-13T01:25:22.642280+0000","last_became_peered":"2026-02-13T01:25:22.642280+0000","last_unstale":"2026-02-13T01:25:22.643886+0000","last_undegraded":"2026-02-13T01:25:22.643886+0000","last_fullsized":"2026-02-13T01:25:22.643886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:02.405845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628037+0000","last_change":"2026-02-13T01:25:13.599415+0000","last_active":"2026-02-13T01:25:22.628037+0000","last_peered":"2026-02-13T01:25:22.628037+0000","last_clean":"2026-02-13T01:25:22.628037+0000","last_became_active":"2026-02-13T01:25:13.599143+0000","last_became_peered":"2026-02-13T01:25:13.599143+0000","last_unstale":"2026-02-13T01:25:22.628037+0000","last_undegraded":"2026-02-13T01:25:22.628037+0000","last_fullsized":"2026-02-13T01:25:22.628037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:31.271789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626521+0000","last_change":"2026-02-13T01:25:13.600494+0000","last_active":"2026-02-13T01:25:22.626521+0000","last_peered":"2026-02-13T01:25:22.626521+0000","last_clean":"2026-02-13T01:25:22.626521+0000","last_became_active":"2026-02-13T01:25:13.600302+0000","last_became_peered":"2026-02-13T01:25:13.600302+0000","last_unstale":"2026-02-13T01:25:22.626521+0000","last_undegraded":"2026-02-13T01:25:22.626521+0000","last_fullsized":"2026-02-13T01:25:22.626521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:50:25.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625992+0000","last_change":"2026-02-13T01:25:12.584795+0000","last_active":"2026-02-13T01:25:22.625992+0000","last_peered":"2026-02-13T01:25:22.625992+0000","last_clean":"2026-02-13T01:25:22.625992+0000","last_became_active":"2026-02-13T01:25:12.584392+0000","last_became_peered":"2026-02-13T01:25:12.584392+0000","last_unstale":"2026-02-13T01:25:22.625992+0000","last_undegraded":"2026-02-13T01:25:22.625992+0000","last_fullsized":"2026-02-13T01:25:22.625992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:47.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642609+0000","last_change":"2026-02-13T01:25:13.600631+0000","last_active":"2026-02-13T01:25:22.642609+0000","last_peered":"2026-02-13T01:25:22.642609+0000","last_clean":"2026-02-13T01:25:22.642609+0000","last_became_active":"2026-02-13T01:25:13.599642+0000","last_became_peered":"2026-02-13T01:25:13.599642+0000","last_unstale":"2026-02-13T01:25:22.642609+0000","last_undegraded":"2026-02-13T01:25:22.642609+0000","last_fullsized":"2026-02-13T01:25:22.642609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:03:02.974206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626019+0000","last_change":"2026-02-13T01:25:12.584754+0000","last_active":"2026-02-13T01:25:22.626019+0000","last_peered":"2026-02-13T01:25:22.626019+0000","last_clean":"2026-02-13T01:25:22.626019+0000","last_became_active":"2026-02-13T01:25:12.584425+0000","last_became_peered":"2026-02-13T01:25:12.584425+0000","last_unstale":"2026-02-13T01:25:22.626019+0000","last_undegraded":"2026-02-13T01:25:22.626019+0000","last_fullsized":"2026-02-13T01:25:22.626019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:32:08.183856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628971+0000","last_change":"2026-02-13T01:25:13.602615+0000","last_active":"2026-02-13T01:25:22.628971+0000","last_peered":"2026-02-13T01:25:22.628971+0000","last_clean":"2026-02-13T01:25:22.628971+0000","last_became_active":"2026-02-13T01:25:13.602511+0000","last_became_peered":"2026-02-13T01:25:13.602511+0000","last_unstale":"2026-02-13T01:25:22.628971+0000","last_undegraded":"2026-02-13T01:25:22.628971+0000","last_fullsized":"2026-02-13T01:25:22.628971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:27:59.716321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630144+0000","last_change":"2026-02-13T01:25:12.588038+0000","last_active":"2026-02-13T01:25:22.630144+0000","last_peered":"2026-02-13T01:25:22.630144+0000","last_clean":"2026-02-13T01:25:22.630144+0000","last_became_active":"2026-02-13T01:25:12.587814+0000","last_became_peered":"2026-02-13T01:25:12.587814+0000","last_unstale":"2026-02-13T01:25:22.630144+0000","last_undegraded":"2026-02-13T01:25:22.630144+0000","last_fullsized":"2026-02-13T01:25:22.630144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:56.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630035+0000","last_change":"2026-02-13T01:25:13.598388+0000","last_active":"2026-02-13T01:25:22.630035+0000","last_peered":"2026-02-13T01:25:22.630035+0000","last_clean":"2026-02-13T01:25:22.630035+0000","last_became_active":"2026-02-13T01:25:13.598128+0000","last_became_peered":"2026-02-13T01:25:13.598128+0000","last_unstale":"2026-02-13T01:25:22.630035+0000","last_undegraded":"2026-02-13T01:25:22.630035+0000","last_fullsized":"2026-02-13T01:25:22.630035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:42.080004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":60,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.630534+0000","last_change":"2026-02-13T01:25:22.633597+0000","last_active":"2026-02-13T01:25:23.630534+0000","last_peered":"2026-02-13T01:25:23.630534+0000","last_clean":"2026-02-13T01:25:23.630534+0000","last_became_active":"2026-02-13T01:25:22.629652+0000","last_became_peered":"2026-02-13T01:25:22.629652+0000","last_unstale":"2026-02-13T01:25:23.630534+0000","last_undegraded":"2026-02-13T01:25:23.630534+0000","last_fullsized":"2026-02-13T01:25:23.630534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:30.389704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60606,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":99,"num_read_kb":115,"num_write":228,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":181818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":184685,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":300107,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":411969,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":10986,"internal_metadata":27579670},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939657,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27936,"kb_used_data":972,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975264,"statfs":{"total":751619276800,"available":751590670336,"internally_reserved":0,"allocated":995328,"data_stored":1055842,"data_compressed":43917,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":36137,"internal_metadata":27554519},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":411489,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":33529,"internal_metadata":27557127},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299404,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27804,"kb_used_data":840,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975396,"statfs":{"total":751619276800,"available":751590805504,"internally_reserved":0,"allocated":860160,"data_stored":411195,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":29269,"internal_metadata":27561387},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27864,"kb_used_data":900,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975336,"statfs":{"total":751619276800,"available":751590744064,"internally_reserved":0,"allocated":921600,"data_stored":1004836,"data_compressed":43917,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":33845,"internal_metadata":27556811},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411184,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":36017,"internal_metadata":27554639},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888082,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27876,"kb_used_data":912,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975324,"statfs":{"total":751619276800,"available":751590731776,"internally_reserved":0,"allocated":933888,"data_stored":1004126,"data_compressed":43917,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":39724,"internal_metadata":27550932},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":412149,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":49090,"internal_metadata":27541566},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247828,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":411009,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":50373,"internal_metadata":27540283},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":466003,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":63032,"internal_metadata":27527624},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607574,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":464985,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":46972,"internal_metadata":27543684},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":55,"kb_used_meta":26888,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412977,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":56402,"internal_metadata":27534254},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11444,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4883,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20956,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21037,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30728,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8292,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14625,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10390,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13650,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22332,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21894,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:27.743 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T01:25:27.895 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:27.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: pgmap v185: 97 pgs: 97 active+clean; 636 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 31 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T01:25:27.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2111749603' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:27.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3592403886' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:27.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2763246848' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/857257643' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1231581024' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1382688076' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2645492775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3511872969' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2240958514' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/472653020' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4290297025' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:27.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1283640585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- 10.20.193.91:0/1274555982 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c1131d0 msgr2=0x7f5d3c173b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- 10.20.193.91:0/1274555982 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c1131d0 0x7f5d3c173b70 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=7351453603787316840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d3800aa70 tx=0x7f5d3802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- 10.20.193.91:0/1274555982 shutdown_connections 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- 10.20.193.91:0/1274555982 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c1131d0 0x7f5d3c173b70 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=7351453603787316840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- 10.20.193.91:0/1274555982 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5d3c10bd50 0x7f5d3c1129f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- 10.20.193.91:0/1274555982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d3c10b360 0x7f5d3c10b730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- 10.20.193.91:0/1274555982 >> 10.20.193.91:0/1274555982 conn(0x7f5d3c062e00 msgr2=0x7f5d3c109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- 10.20.193.91:0/1274555982 shutdown_connections 2026-02-13T01:25:28.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- 10.20.193.91:0/1274555982 wait complete. 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 Processor -- start 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- start start 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 0x7f5d3c0f45b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d3c1131d0 0x7f5d3c173a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5d3c0f4be0 0x7f5d3c0f9eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0f52d0 con 0x7f5d3c10b360 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0fa3f0 con 0x7f5d3c1131d0 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d446616c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c0fa5b0 con 0x7f5d3c0f4be0 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 0x7f5d3c0f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 0x7f5d3c0f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44952/0 (socket says 10.20.193.91:44952) 2026-02-13T01:25:28.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 -- 10.20.193.91:0/2363600256 learned_addr learned my addr 10.20.193.91:0/2363600256 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d41bd16c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d3c1131d0 0x7f5d3c173a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 -- 10.20.193.91:0/2363600256 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5d3c0f4be0 msgr2=0x7f5d3c0f9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5d3c0f4be0 0x7f5d3c0f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 -- 10.20.193.91:0/2363600256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d3c1131d0 msgr2=0x7f5d3c173a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d3c1131d0 0x7f5d3c173a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 -- 10.20.193.91:0/2363600256 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3800a660 con 0x7f5d3c10b360 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d423d26c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 0x7f5d3c0f45b0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d2c00b710 tx=0x7f5d2c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.012+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d2c004250 con 0x7f5d3c10b360 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.013+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c0fa890 con 0x7f5d3c10b360 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.013+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5d2c002d80 con 0x7f5d3c10b360 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.013+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d2c00cda0 con 0x7f5d3c10b360 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.013+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c0fb020 con 0x7f5d3c10b360 2026-02-13T01:25:28.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.013+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c05f220 con 0x7f5d3c10b360 2026-02-13T01:25:28.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.014+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f5d2c0028c0 con 0x7f5d3c10b360 2026-02-13T01:25:28.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.015+0000 7f5d237fe6c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5d180b56e0 0x7f5d180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.015+0000 7f5d41bd16c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5d180b56e0 0x7f5d180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.015+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f5d2c0e3e00 con 0x7f5d3c10b360 2026-02-13T01:25:28.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.015+0000 7f5d41bd16c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5d180b56e0 0x7f5d180d5b90 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d30005980 tx=0x7f5d30005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:28.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.015+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5d2c0aa0a0 con 0x7f5d3c10b360 2026-02-13T01:25:28.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: pgmap v185: 97 pgs: 97 active+clean; 636 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 31 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T01:25:28.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2111749603' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T01:25:28.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3592403886' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T01:25:28.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2763246848' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T01:25:28.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/857257643' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1231581024' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1382688076' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2645492775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3511872969' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2240958514' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/472653020' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4290297025' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T01:25:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1283640585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T01:25:28.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.104+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 --> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d3c0f5700 con 0x7f5d180b56e0 2026-02-13T01:25:28.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.106+0000 7f5d237fe6c0 1 -- 10.20.193.91:0/2363600256 <== mgr.14190 v2:10.20.193.91:6800/3278861816 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259133 (secure 0 0 0) 0x7f5d3c0f5700 con 0x7f5d180b56e0 2026-02-13T01:25:28.108 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:28.110 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5d180b56e0 msgr2=0x7f5d180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5d180b56e0 0x7f5d180d5b90 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d30005980 tx=0x7f5d30005910 comp rx=0 tx=0).stop 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 msgr2=0x7f5d3c0f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 0x7f5d3c0f45b0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d2c00b710 tx=0x7f5d2c00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 shutdown_connections 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5d180b56e0 0x7f5d180d5b90 unknown :-1 s=CLOSED pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5d3c0f4be0 0x7f5d3c0f9eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d3c1131d0 0x7f5d3c173a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 --2- 10.20.193.91:0/2363600256 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5d3c10b360 0x7f5d3c0f45b0 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 >> 10.20.193.91:0/2363600256 conn(0x7f5d3c062e00 msgr2=0x7f5d3c10e780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:28.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 shutdown_connections 2026-02-13T01:25:28.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.108+0000 7f5d446616c0 1 -- 10.20.193.91:0/2363600256 wait complete. 2026-02-13T01:25:28.149 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2026-02-13T01:25:26.557283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651208,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":213,"num_read_kb":214,"num_write":419,"num_write_kb":3848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1181430,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":353,"ondisk_log_size":353,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334056,"kb_used_data":10488,"kb_used_omap":474,"kb_used_meta":322854,"kb_avail":8807704344,"statfs":{"total":9019431321600,"available":9019089248256,"internally_reserved":0,"allocated":10739712,"data_stored":6877764,"data_compressed":183798,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":485376,"internal_metadata":330602496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":58072,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":99,"num_read_kb":115,"num_write":154,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001482"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626783+0000","last_change":"2026-02-13T01:25:13.598845+0000","last_active":"2026-02-13T01:25:22.626783+0000","last_peered":"2026-02-13T01:25:22.626783+0000","last_clean":"2026-02-13T01:25:22.626783+0000","last_became_active":"2026-02-13T01:25:13.598609+0000","last_became_peered":"2026-02-13T01:25:13.598609+0000","last_unstale":"2026-02-13T01:25:22.626783+0000","last_undegraded":"2026-02-13T01:25:22.626783+0000","last_fullsized":"2026-02-13T01:25:22.626783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:13.127033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628742+0000","last_change":"2026-02-13T01:25:13.599778+0000","last_active":"2026-02-13T01:25:22.628742+0000","last_peered":"2026-02-13T01:25:22.628742+0000","last_clean":"2026-02-13T01:25:22.628742+0000","last_became_active":"2026-02-13T01:25:13.599585+0000","last_became_peered":"2026-02-13T01:25:13.599585+0000","last_unstale":"2026-02-13T01:25:22.628742+0000","last_undegraded":"2026-02-13T01:25:22.628742+0000","last_fullsized":"2026-02-13T01:25:22.628742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:23:42.837760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628598+0000","last_change":"2026-02-13T01:25:13.602206+0000","last_active":"2026-02-13T01:25:22.628598+0000","last_peered":"2026-02-13T01:25:22.628598+0000","last_clean":"2026-02-13T01:25:22.628598+0000","last_became_active":"2026-02-13T01:25:13.602099+0000","last_became_peered":"2026-02-13T01:25:13.602099+0000","last_unstale":"2026-02-13T01:25:22.628598+0000","last_undegraded":"2026-02-13T01:25:22.628598+0000","last_fullsized":"2026-02-13T01:25:22.628598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:31:31.903965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626504+0000","last_change":"2026-02-13T01:25:13.596389+0000","last_active":"2026-02-13T01:25:22.626504+0000","last_peered":"2026-02-13T01:25:22.626504+0000","last_clean":"2026-02-13T01:25:22.626504+0000","last_became_active":"2026-02-13T01:25:13.596165+0000","last_became_peered":"2026-02-13T01:25:13.596165+0000","last_unstale":"2026-02-13T01:25:22.626504+0000","last_undegraded":"2026-02-13T01:25:22.626504+0000","last_fullsized":"2026-02-13T01:25:22.626504+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:43:09.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.631936+0000","last_change":"2026-02-13T01:25:22.631892+0000","last_active":"2026-02-13T01:25:22.631936+0000","last_peered":"2026-02-13T01:25:22.631936+0000","last_clean":"2026-02-13T01:25:22.631936+0000","last_became_active":"2026-02-13T01:25:22.631664+0000","last_became_peered":"2026-02-13T01:25:22.631664+0000","last_unstale":"2026-02-13T01:25:22.631936+0000","last_undegraded":"2026-02-13T01:25:22.631936+0000","last_fullsized":"2026-02-13T01:25:22.631936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:06:54.247371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626116+0000","last_change":"2026-02-13T01:25:13.595155+0000","last_active":"2026-02-13T01:25:22.626116+0000","last_peered":"2026-02-13T01:25:22.626116+0000","last_clean":"2026-02-13T01:25:22.626116+0000","last_became_active":"2026-02-13T01:25:13.594858+0000","last_became_peered":"2026-02-13T01:25:13.594858+0000","last_unstale":"2026-02-13T01:25:22.626116+0000","last_undegraded":"2026-02-13T01:25:22.626116+0000","last_fullsized":"2026-02-13T01:25:22.626116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:29:34.717120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627859+0000","last_change":"2026-02-13T01:25:13.596326+0000","last_active":"2026-02-13T01:25:22.627859+0000","last_peered":"2026-02-13T01:25:22.627859+0000","last_clean":"2026-02-13T01:25:22.627859+0000","last_became_active":"2026-02-13T01:25:13.595964+0000","last_became_peered":"2026-02-13T01:25:13.595964+0000","last_unstale":"2026-02-13T01:25:22.627859+0000","last_undegraded":"2026-02-13T01:25:22.627859+0000","last_fullsized":"2026-02-13T01:25:22.627859+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:07:18.022160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629718+0000","last_change":"2026-02-13T01:25:13.598247+0000","last_active":"2026-02-13T01:25:22.629718+0000","last_peered":"2026-02-13T01:25:22.629718+0000","last_clean":"2026-02-13T01:25:22.629718+0000","last_became_active":"2026-02-13T01:25:13.598098+0000","last_became_peered":"2026-02-13T01:25:13.598098+0000","last_unstale":"2026-02-13T01:25:22.629718+0000","last_undegraded":"2026-02-13T01:25:22.629718+0000","last_fullsized":"2026-02-13T01:25:22.629718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:21:41.227689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642811+0000","last_change":"2026-02-13T01:25:13.601183+0000","last_active":"2026-02-13T01:25:22.642811+0000","last_peered":"2026-02-13T01:25:22.642811+0000","last_clean":"2026-02-13T01:25:22.642811+0000","last_became_active":"2026-02-13T01:25:13.600958+0000","last_became_peered":"2026-02-13T01:25:13.600958+0000","last_unstale":"2026-02-13T01:25:22.642811+0000","last_undegraded":"2026-02-13T01:25:22.642811+0000","last_fullsized":"2026-02-13T01:25:22.642811+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:15:12.659724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626383+0000","last_change":"2026-02-13T01:25:13.595002+0000","last_active":"2026-02-13T01:25:22.626383+0000","last_peered":"2026-02-13T01:25:22.626383+0000","last_clean":"2026-02-13T01:25:22.626383+0000","last_became_active":"2026-02-13T01:25:13.594709+0000","last_became_peered":"2026-02-13T01:25:13.594709+0000","last_unstale":"2026-02-13T01:25:22.626383+0000","last_undegraded":"2026-02-13T01:25:22.626383+0000","last_fullsized":"2026-02-13T01:25:22.626383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:42:01.732241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628063+0000","last_change":"2026-02-13T01:25:13.599426+0000","last_active":"2026-02-13T01:25:22.628063+0000","last_peered":"2026-02-13T01:25:22.628063+0000","last_clean":"2026-02-13T01:25:22.628063+0000","last_became_active":"2026-02-13T01:25:13.599121+0000","last_became_peered":"2026-02-13T01:25:13.599121+0000","last_unstale":"2026-02-13T01:25:22.628063+0000","last_undegraded":"2026-02-13T01:25:22.628063+0000","last_fullsized":"2026-02-13T01:25:22.628063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:39:43.625554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626618+0000","last_change":"2026-02-13T01:25:13.595569+0000","last_active":"2026-02-13T01:25:22.626618+0000","last_peered":"2026-02-13T01:25:22.626618+0000","last_clean":"2026-02-13T01:25:22.626618+0000","last_became_active":"2026-02-13T01:25:13.595429+0000","last_became_peered":"2026-02-13T01:25:13.595429+0000","last_unstale":"2026-02-13T01:25:22.626618+0000","last_undegraded":"2026-02-13T01:25:22.626618+0000","last_fullsized":"2026-02-13T01:25:22.626618+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:03.129382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633164+0000","last_change":"2026-02-13T01:25:13.596331+0000","last_active":"2026-02-13T01:25:22.633164+0000","last_peered":"2026-02-13T01:25:22.633164+0000","last_clean":"2026-02-13T01:25:22.633164+0000","last_became_active":"2026-02-13T01:25:13.596110+0000","last_became_peered":"2026-02-13T01:25:13.596110+0000","last_unstale":"2026-02-13T01:25:22.633164+0000","last_undegraded":"2026-02-13T01:25:22.633164+0000","last_fullsized":"2026-02-13T01:25:22.633164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:48:05.074653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628509+0000","last_change":"2026-02-13T01:25:13.599783+0000","last_active":"2026-02-13T01:25:22.628509+0000","last_peered":"2026-02-13T01:25:22.628509+0000","last_clean":"2026-02-13T01:25:22.628509+0000","last_became_active":"2026-02-13T01:25:13.599599+0000","last_became_peered":"2026-02-13T01:25:13.599599+0000","last_unstale":"2026-02-13T01:25:22.628509+0000","last_undegraded":"2026-02-13T01:25:22.628509+0000","last_fullsized":"2026-02-13T01:25:22.628509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:50.944319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628522+0000","last_change":"2026-02-13T01:25:13.600374+0000","last_active":"2026-02-13T01:25:22.628522+0000","last_peered":"2026-02-13T01:25:22.628522+0000","last_clean":"2026-02-13T01:25:22.628522+0000","last_became_active":"2026-02-13T01:25:13.600257+0000","last_became_peered":"2026-02-13T01:25:13.600257+0000","last_unstale":"2026-02-13T01:25:22.628522+0000","last_undegraded":"2026-02-13T01:25:22.628522+0000","last_fullsized":"2026-02-13T01:25:22.628522+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:53:52.750448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642493+0000","last_change":"2026-02-13T01:25:13.600258+0000","last_active":"2026-02-13T01:25:22.642493+0000","last_peered":"2026-02-13T01:25:22.642493+0000","last_clean":"2026-02-13T01:25:22.642493+0000","last_became_active":"2026-02-13T01:25:13.599763+0000","last_became_peered":"2026-02-13T01:25:13.599763+0000","last_unstale":"2026-02-13T01:25:22.642493+0000","last_undegraded":"2026-02-13T01:25:22.642493+0000","last_fullsized":"2026-02-13T01:25:22.642493+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:36:19.768078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626940+0000","last_change":"2026-02-13T01:25:13.598638+0000","last_active":"2026-02-13T01:25:22.626940+0000","last_peered":"2026-02-13T01:25:22.626940+0000","last_clean":"2026-02-13T01:25:22.626940+0000","last_became_active":"2026-02-13T01:25:13.598461+0000","last_became_peered":"2026-02-13T01:25:13.598461+0000","last_unstale":"2026-02-13T01:25:22.626940+0000","last_undegraded":"2026-02-13T01:25:22.626940+0000","last_fullsized":"2026-02-13T01:25:22.626940+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:01.237039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629211+0000","last_change":"2026-02-13T01:25:13.599839+0000","last_active":"2026-02-13T01:25:22.629211+0000","last_peered":"2026-02-13T01:25:22.629211+0000","last_clean":"2026-02-13T01:25:22.629211+0000","last_became_active":"2026-02-13T01:25:13.599737+0000","last_became_peered":"2026-02-13T01:25:13.599737+0000","last_unstale":"2026-02-13T01:25:22.629211+0000","last_undegraded":"2026-02-13T01:25:22.629211+0000","last_fullsized":"2026-02-13T01:25:22.629211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:44:20.073558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627207+0000","last_change":"2026-02-13T01:25:13.596751+0000","last_active":"2026-02-13T01:25:22.627207+0000","last_peered":"2026-02-13T01:25:22.627207+0000","last_clean":"2026-02-13T01:25:22.627207+0000","last_became_active":"2026-02-13T01:25:13.596474+0000","last_became_peered":"2026-02-13T01:25:13.596474+0000","last_unstale":"2026-02-13T01:25:22.627207+0000","last_undegraded":"2026-02-13T01:25:22.627207+0000","last_fullsized":"2026-02-13T01:25:22.627207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:56.315292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628087+0000","last_change":"2026-02-13T01:25:22.628052+0000","last_active":"2026-02-13T01:25:22.628087+0000","last_peered":"2026-02-13T01:25:22.628087+0000","last_clean":"2026-02-13T01:25:22.628087+0000","last_became_active":"2026-02-13T01:25:22.627937+0000","last_became_peered":"2026-02-13T01:25:22.627937+0000","last_unstale":"2026-02-13T01:25:22.628087+0000","last_undegraded":"2026-02-13T01:25:22.628087+0000","last_fullsized":"2026-02-13T01:25:22.628087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:06:22.940095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633212+0000","last_change":"2026-02-13T01:25:13.597356+0000","last_active":"2026-02-13T01:25:22.633212+0000","last_peered":"2026-02-13T01:25:22.633212+0000","last_clean":"2026-02-13T01:25:22.633212+0000","last_became_active":"2026-02-13T01:25:13.597245+0000","last_became_peered":"2026-02-13T01:25:13.597245+0000","last_unstale":"2026-02-13T01:25:22.633212+0000","last_undegraded":"2026-02-13T01:25:22.633212+0000","last_fullsized":"2026-02-13T01:25:22.633212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:40:58.602043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642683+0000","last_change":"2026-02-13T01:25:13.599295+0000","last_active":"2026-02-13T01:25:22.642683+0000","last_peered":"2026-02-13T01:25:22.642683+0000","last_clean":"2026-02-13T01:25:22.642683+0000","last_became_active":"2026-02-13T01:25:13.599011+0000","last_became_peered":"2026-02-13T01:25:13.599011+0000","last_unstale":"2026-02-13T01:25:22.642683+0000","last_undegraded":"2026-02-13T01:25:22.642683+0000","last_fullsized":"2026-02-13T01:25:22.642683+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:29:03.099795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629747+0000","last_change":"2026-02-13T01:25:13.596927+0000","last_active":"2026-02-13T01:25:22.629747+0000","last_peered":"2026-02-13T01:25:22.629747+0000","last_clean":"2026-02-13T01:25:22.629747+0000","last_became_active":"2026-02-13T01:25:13.596694+0000","last_became_peered":"2026-02-13T01:25:13.596694+0000","last_unstale":"2026-02-13T01:25:22.629747+0000","last_undegraded":"2026-02-13T01:25:22.629747+0000","last_fullsized":"2026-02-13T01:25:22.629747+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:12.958466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626456+0000","last_change":"2026-02-13T01:25:13.597186+0000","last_active":"2026-02-13T01:25:22.626456+0000","last_peered":"2026-02-13T01:25:22.626456+0000","last_clean":"2026-02-13T01:25:22.626456+0000","last_became_active":"2026-02-13T01:25:13.596845+0000","last_became_peered":"2026-02-13T01:25:13.596845+0000","last_unstale":"2026-02-13T01:25:22.626456+0000","last_undegraded":"2026-02-13T01:25:22.626456+0000","last_fullsized":"2026-02-13T01:25:22.626456+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:50:15.787511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630142+0000","last_change":"2026-02-13T01:25:13.598968+0000","last_active":"2026-02-13T01:25:22.630142+0000","last_peered":"2026-02-13T01:25:22.630142+0000","last_clean":"2026-02-13T01:25:22.630142+0000","last_became_active":"2026-02-13T01:25:13.598579+0000","last_became_peered":"2026-02-13T01:25:13.598579+0000","last_unstale":"2026-02-13T01:25:22.630142+0000","last_undegraded":"2026-02-13T01:25:22.630142+0000","last_fullsized":"2026-02-13T01:25:22.630142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:45:49.051626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627400+0000","last_change":"2026-02-13T01:25:13.598068+0000","last_active":"2026-02-13T01:25:22.627400+0000","last_peered":"2026-02-13T01:25:22.627400+0000","last_clean":"2026-02-13T01:25:22.627400+0000","last_became_active":"2026-02-13T01:25:13.597724+0000","last_became_peered":"2026-02-13T01:25:13.597724+0000","last_unstale":"2026-02-13T01:25:22.627400+0000","last_undegraded":"2026-02-13T01:25:22.627400+0000","last_fullsized":"2026-02-13T01:25:22.627400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:48.542392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626633+0000","last_change":"2026-02-13T01:25:13.594807+0000","last_active":"2026-02-13T01:25:22.626633+0000","last_peered":"2026-02-13T01:25:22.626633+0000","last_clean":"2026-02-13T01:25:22.626633+0000","last_became_active":"2026-02-13T01:25:13.594367+0000","last_became_peered":"2026-02-13T01:25:13.594367+0000","last_unstale":"2026-02-13T01:25:22.626633+0000","last_undegraded":"2026-02-13T01:25:22.626633+0000","last_fullsized":"2026-02-13T01:25:22.626633+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:00:03.116695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633246+0000","last_change":"2026-02-13T01:25:13.595823+0000","last_active":"2026-02-13T01:25:22.633246+0000","last_peered":"2026-02-13T01:25:22.633246+0000","last_clean":"2026-02-13T01:25:22.633246+0000","last_became_active":"2026-02-13T01:25:13.595587+0000","last_became_peered":"2026-02-13T01:25:13.595587+0000","last_unstale":"2026-02-13T01:25:22.633246+0000","last_undegraded":"2026-02-13T01:25:22.633246+0000","last_fullsized":"2026-02-13T01:25:22.633246+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:57:11.801697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633527+0000","last_change":"2026-02-13T01:25:22.633482+0000","last_active":"2026-02-13T01:25:22.633527+0000","last_peered":"2026-02-13T01:25:22.633527+0000","last_clean":"2026-02-13T01:25:22.633527+0000","last_became_active":"2026-02-13T01:25:22.633319+0000","last_became_peered":"2026-02-13T01:25:22.633319+0000","last_unstale":"2026-02-13T01:25:22.633527+0000","last_undegraded":"2026-02-13T01:25:22.633527+0000","last_fullsized":"2026-02-13T01:25:22.633527+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:59:14.570108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,8],"acting":[0,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627201+0000","last_change":"2026-02-13T01:25:13.596471+0000","last_active":"2026-02-13T01:25:22.627201+0000","last_peered":"2026-02-13T01:25:22.627201+0000","last_clean":"2026-02-13T01:25:22.627201+0000","last_became_active":"2026-02-13T01:25:13.596238+0000","last_became_peered":"2026-02-13T01:25:13.596238+0000","last_unstale":"2026-02-13T01:25:22.627201+0000","last_undegraded":"2026-02-13T01:25:22.627201+0000","last_fullsized":"2026-02-13T01:25:22.627201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:05:24.893159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627215+0000","last_change":"2026-02-13T01:25:13.597034+0000","last_active":"2026-02-13T01:25:22.627215+0000","last_peered":"2026-02-13T01:25:22.627215+0000","last_clean":"2026-02-13T01:25:22.627215+0000","last_became_active":"2026-02-13T01:25:13.596573+0000","last_became_peered":"2026-02-13T01:25:13.596573+0000","last_unstale":"2026-02-13T01:25:22.627215+0000","last_undegraded":"2026-02-13T01:25:22.627215+0000","last_fullsized":"2026-02-13T01:25:22.627215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:49:51.020546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626519+0000","last_change":"2026-02-13T01:25:13.594615+0000","last_active":"2026-02-13T01:25:22.626519+0000","last_peered":"2026-02-13T01:25:22.626519+0000","last_clean":"2026-02-13T01:25:22.626519+0000","last_became_active":"2026-02-13T01:25:13.594349+0000","last_became_peered":"2026-02-13T01:25:13.594349+0000","last_unstale":"2026-02-13T01:25:22.626519+0000","last_undegraded":"2026-02-13T01:25:22.626519+0000","last_fullsized":"2026-02-13T01:25:22.626519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:03.697709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625856+0000","last_change":"2026-02-13T01:25:13.595949+0000","last_active":"2026-02-13T01:25:22.625856+0000","last_peered":"2026-02-13T01:25:22.625856+0000","last_clean":"2026-02-13T01:25:22.625856+0000","last_became_active":"2026-02-13T01:25:13.595183+0000","last_became_peered":"2026-02-13T01:25:13.595183+0000","last_unstale":"2026-02-13T01:25:22.625856+0000","last_undegraded":"2026-02-13T01:25:22.625856+0000","last_fullsized":"2026-02-13T01:25:22.625856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:19:36.191774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":37,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.606322+0000","last_change":"2026-02-13T01:25:12.586512+0000","last_active":"2026-02-13T01:25:24.606322+0000","last_peered":"2026-02-13T01:25:24.606322+0000","last_clean":"2026-02-13T01:25:24.606322+0000","last_became_active":"2026-02-13T01:25:12.586332+0000","last_became_peered":"2026-02-13T01:25:12.586332+0000","last_unstale":"2026-02-13T01:25:24.606322+0000","last_undegraded":"2026-02-13T01:25:24.606322+0000","last_fullsized":"2026-02-13T01:25:24.606322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:04.971228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626532+0000","last_change":"2026-02-13T01:25:13.596348+0000","last_active":"2026-02-13T01:25:22.626532+0000","last_peered":"2026-02-13T01:25:22.626532+0000","last_clean":"2026-02-13T01:25:22.626532+0000","last_became_active":"2026-02-13T01:25:13.596143+0000","last_became_peered":"2026-02-13T01:25:13.596143+0000","last_unstale":"2026-02-13T01:25:22.626532+0000","last_undegraded":"2026-02-13T01:25:22.626532+0000","last_fullsized":"2026-02-13T01:25:22.626532+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:49:34.818946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'7","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626172+0000","last_change":"2026-02-13T01:25:12.583872+0000","last_active":"2026-02-13T01:25:22.626172+0000","last_peered":"2026-02-13T01:25:22.626172+0000","last_clean":"2026-02-13T01:25:22.626172+0000","last_became_active":"2026-02-13T01:25:12.583688+0000","last_became_peered":"2026-02-13T01:25:12.583688+0000","last_unstale":"2026-02-13T01:25:22.626172+0000","last_undegraded":"2026-02-13T01:25:22.626172+0000","last_fullsized":"2026-02-13T01:25:22.626172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:24:57.991039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633044+0000","last_change":"2026-02-13T01:25:12.585552+0000","last_active":"2026-02-13T01:25:22.633044+0000","last_peered":"2026-02-13T01:25:22.633044+0000","last_clean":"2026-02-13T01:25:22.633044+0000","last_became_active":"2026-02-13T01:25:12.585237+0000","last_became_peered":"2026-02-13T01:25:12.585237+0000","last_unstale":"2026-02-13T01:25:22.633044+0000","last_undegraded":"2026-02-13T01:25:22.633044+0000","last_fullsized":"2026-02-13T01:25:22.633044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:33:48.661981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629768+0000","last_change":"2026-02-13T01:25:13.597739+0000","last_active":"2026-02-13T01:25:22.629768+0000","last_peered":"2026-02-13T01:25:22.629768+0000","last_clean":"2026-02-13T01:25:22.629768+0000","last_became_active":"2026-02-13T01:25:13.597579+0000","last_became_peered":"2026-02-13T01:25:13.597579+0000","last_unstale":"2026-02-13T01:25:22.629768+0000","last_undegraded":"2026-02-13T01:25:22.629768+0000","last_fullsized":"2026-02-13T01:25:22.629768+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T01:34:45.020931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626750+0000","last_change":"2026-02-13T01:25:12.586197+0000","last_active":"2026-02-13T01:25:22.626750+0000","last_peered":"2026-02-13T01:25:22.626750+0000","last_clean":"2026-02-13T01:25:22.626750+0000","last_became_active":"2026-02-13T01:25:12.585596+0000","last_became_peered":"2026-02-13T01:25:12.585596+0000","last_unstale":"2026-02-13T01:25:22.626750+0000","last_undegraded":"2026-02-13T01:25:22.626750+0000","last_fullsized":"2026-02-13T01:25:22.626750+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:43:32.118426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628933+0000","last_change":"2026-02-13T01:25:13.597729+0000","last_active":"2026-02-13T01:25:22.628933+0000","last_peered":"2026-02-13T01:25:22.628933+0000","last_clean":"2026-02-13T01:25:22.628933+0000","last_became_active":"2026-02-13T01:25:13.597613+0000","last_became_peered":"2026-02-13T01:25:13.597613+0000","last_unstale":"2026-02-13T01:25:22.628933+0000","last_undegraded":"2026-02-13T01:25:22.628933+0000","last_fullsized":"2026-02-13T01:25:22.628933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:55:31.684388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'4","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.606855+0000","last_change":"2026-02-13T01:25:12.586878+0000","last_active":"2026-02-13T01:25:24.606855+0000","last_peered":"2026-02-13T01:25:24.606855+0000","last_clean":"2026-02-13T01:25:24.606855+0000","last_became_active":"2026-02-13T01:25:12.586734+0000","last_became_peered":"2026-02-13T01:25:12.586734+0000","last_unstale":"2026-02-13T01:25:24.606855+0000","last_undegraded":"2026-02-13T01:25:24.606855+0000","last_fullsized":"2026-02-13T01:25:24.606855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:29:16.007641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642709+0000","last_change":"2026-02-13T01:25:13.599851+0000","last_active":"2026-02-13T01:25:22.642709+0000","last_peered":"2026-02-13T01:25:22.642709+0000","last_clean":"2026-02-13T01:25:22.642709+0000","last_became_active":"2026-02-13T01:25:13.599378+0000","last_became_peered":"2026-02-13T01:25:13.599378+0000","last_unstale":"2026-02-13T01:25:22.642709+0000","last_undegraded":"2026-02-13T01:25:22.642709+0000","last_fullsized":"2026-02-13T01:25:22.642709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:36:17.930220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628060+0000","last_change":"2026-02-13T01:25:12.586174+0000","last_active":"2026-02-13T01:25:22.628060+0000","last_peered":"2026-02-13T01:25:22.628060+0000","last_clean":"2026-02-13T01:25:22.628060+0000","last_became_active":"2026-02-13T01:25:12.585898+0000","last_became_peered":"2026-02-13T01:25:12.585898+0000","last_unstale":"2026-02-13T01:25:22.628060+0000","last_undegraded":"2026-02-13T01:25:22.628060+0000","last_fullsized":"2026-02-13T01:25:22.628060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:50:48.499836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628981+0000","last_change":"2026-02-13T01:25:13.599679+0000","last_active":"2026-02-13T01:25:22.628981+0000","last_peered":"2026-02-13T01:25:22.628981+0000","last_clean":"2026-02-13T01:25:22.628981+0000","last_became_active":"2026-02-13T01:25:13.599505+0000","last_became_peered":"2026-02-13T01:25:13.599505+0000","last_unstale":"2026-02-13T01:25:22.628981+0000","last_undegraded":"2026-02-13T01:25:22.628981+0000","last_fullsized":"2026-02-13T01:25:22.628981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:20:55.098705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'5","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626760+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:22.626760+0000","last_peered":"2026-02-13T01:25:22.626760+0000","last_clean":"2026-02-13T01:25:22.626760+0000","last_became_active":"2026-02-13T01:25:12.584983+0000","last_became_peered":"2026-02-13T01:25:12.584983+0000","last_unstale":"2026-02-13T01:25:22.626760+0000","last_undegraded":"2026-02-13T01:25:22.626760+0000","last_fullsized":"2026-02-13T01:25:22.626760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:19:34.247623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642698+0000","last_change":"2026-02-13T01:25:13.600875+0000","last_active":"2026-02-13T01:25:22.642698+0000","last_peered":"2026-02-13T01:25:22.642698+0000","last_clean":"2026-02-13T01:25:22.642698+0000","last_became_active":"2026-02-13T01:25:13.600022+0000","last_became_peered":"2026-02-13T01:25:13.600022+0000","last_unstale":"2026-02-13T01:25:22.642698+0000","last_undegraded":"2026-02-13T01:25:22.642698+0000","last_fullsized":"2026-02-13T01:25:22.642698+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:12.241807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'24","reported_seq":63,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.610254+0000","last_change":"2026-02-13T01:25:12.585602+0000","last_active":"2026-02-13T01:25:24.610254+0000","last_peered":"2026-02-13T01:25:24.610254+0000","last_clean":"2026-02-13T01:25:24.610254+0000","last_became_active":"2026-02-13T01:25:12.585421+0000","last_became_peered":"2026-02-13T01:25:12.585421+0000","last_unstale":"2026-02-13T01:25:24.610254+0000","last_undegraded":"2026-02-13T01:25:24.610254+0000","last_fullsized":"2026-02-13T01:25:24.610254+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:40:42.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":61,"num_write":26,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626023+0000","last_change":"2026-02-13T01:25:13.595983+0000","last_active":"2026-02-13T01:25:22.626023+0000","last_peered":"2026-02-13T01:25:22.626023+0000","last_clean":"2026-02-13T01:25:22.626023+0000","last_became_active":"2026-02-13T01:25:13.594518+0000","last_became_peered":"2026-02-13T01:25:13.594518+0000","last_unstale":"2026-02-13T01:25:22.626023+0000","last_undegraded":"2026-02-13T01:25:22.626023+0000","last_fullsized":"2026-02-13T01:25:22.626023+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:43:16.951050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'9","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627439+0000","last_change":"2026-02-13T01:25:12.585520+0000","last_active":"2026-02-13T01:25:22.627439+0000","last_peered":"2026-02-13T01:25:22.627439+0000","last_clean":"2026-02-13T01:25:22.627439+0000","last_became_active":"2026-02-13T01:25:12.584720+0000","last_became_peered":"2026-02-13T01:25:12.584720+0000","last_unstale":"2026-02-13T01:25:22.627439+0000","last_undegraded":"2026-02-13T01:25:22.627439+0000","last_fullsized":"2026-02-13T01:25:22.627439+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:19:52.811064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633065+0000","last_change":"2026-02-13T01:25:13.597736+0000","last_active":"2026-02-13T01:25:22.633065+0000","last_peered":"2026-02-13T01:25:22.633065+0000","last_clean":"2026-02-13T01:25:22.633065+0000","last_became_active":"2026-02-13T01:25:13.597635+0000","last_became_peered":"2026-02-13T01:25:13.597635+0000","last_unstale":"2026-02-13T01:25:22.633065+0000","last_undegraded":"2026-02-13T01:25:22.633065+0000","last_fullsized":"2026-02-13T01:25:22.633065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:09.718614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'5","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626494+0000","last_change":"2026-02-13T01:25:12.585611+0000","last_active":"2026-02-13T01:25:22.626494+0000","last_peered":"2026-02-13T01:25:22.626494+0000","last_clean":"2026-02-13T01:25:22.626494+0000","last_became_active":"2026-02-13T01:25:12.585213+0000","last_became_peered":"2026-02-13T01:25:12.585213+0000","last_unstale":"2026-02-13T01:25:22.626494+0000","last_undegraded":"2026-02-13T01:25:22.626494+0000","last_fullsized":"2026-02-13T01:25:22.626494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:58.518168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628110+0000","last_change":"2026-02-13T01:25:13.596481+0000","last_active":"2026-02-13T01:25:22.628110+0000","last_peered":"2026-02-13T01:25:22.628110+0000","last_clean":"2026-02-13T01:25:22.628110+0000","last_became_active":"2026-02-13T01:25:13.596188+0000","last_became_peered":"2026-02-13T01:25:13.596188+0000","last_unstale":"2026-02-13T01:25:22.628110+0000","last_undegraded":"2026-02-13T01:25:22.628110+0000","last_fullsized":"2026-02-13T01:25:22.628110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:27:31.070201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'6","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.608400+0000","last_change":"2026-02-13T01:25:12.585557+0000","last_active":"2026-02-13T01:25:23.608400+0000","last_peered":"2026-02-13T01:25:23.608400+0000","last_clean":"2026-02-13T01:25:23.608400+0000","last_became_active":"2026-02-13T01:25:12.585406+0000","last_became_peered":"2026-02-13T01:25:12.585406+0000","last_unstale":"2026-02-13T01:25:23.608400+0000","last_undegraded":"2026-02-13T01:25:23.608400+0000","last_fullsized":"2026-02-13T01:25:23.608400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:27.444543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627826+0000","last_change":"2026-02-13T01:25:13.596633+0000","last_active":"2026-02-13T01:25:22.627826+0000","last_peered":"2026-02-13T01:25:22.627826+0000","last_clean":"2026-02-13T01:25:22.627826+0000","last_became_active":"2026-02-13T01:25:13.596408+0000","last_became_peered":"2026-02-13T01:25:13.596408+0000","last_unstale":"2026-02-13T01:25:22.627826+0000","last_undegraded":"2026-02-13T01:25:22.627826+0000","last_fullsized":"2026-02-13T01:25:22.627826+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:04:43.368134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'17","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625610+0000","last_change":"2026-02-13T01:25:12.585798+0000","last_active":"2026-02-13T01:25:22.625610+0000","last_peered":"2026-02-13T01:25:22.625610+0000","last_clean":"2026-02-13T01:25:22.625610+0000","last_became_active":"2026-02-13T01:25:12.585641+0000","last_became_peered":"2026-02-13T01:25:12.585641+0000","last_unstale":"2026-02-13T01:25:22.625610+0000","last_undegraded":"2026-02-13T01:25:22.625610+0000","last_fullsized":"2026-02-13T01:25:22.625610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:16:39.636368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.644045+0000","last_change":"2026-02-13T01:25:22.643876+0000","last_active":"2026-02-13T01:25:22.644045+0000","last_peered":"2026-02-13T01:25:22.644045+0000","last_clean":"2026-02-13T01:25:22.644045+0000","last_became_active":"2026-02-13T01:25:22.643738+0000","last_became_peered":"2026-02-13T01:25:22.643738+0000","last_unstale":"2026-02-13T01:25:22.644045+0000","last_undegraded":"2026-02-13T01:25:22.644045+0000","last_fullsized":"2026-02-13T01:25:22.644045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:39.300474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626122+0000","last_change":"2026-02-13T01:25:12.585124+0000","last_active":"2026-02-13T01:25:22.626122+0000","last_peered":"2026-02-13T01:25:22.626122+0000","last_clean":"2026-02-13T01:25:22.626122+0000","last_became_active":"2026-02-13T01:25:12.584899+0000","last_became_peered":"2026-02-13T01:25:12.584899+0000","last_unstale":"2026-02-13T01:25:22.626122+0000","last_undegraded":"2026-02-13T01:25:22.626122+0000","last_fullsized":"2026-02-13T01:25:22.626122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:05:20.160445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626690+0000","last_change":"2026-02-13T01:25:13.594139+0000","last_active":"2026-02-13T01:25:22.626690+0000","last_peered":"2026-02-13T01:25:22.626690+0000","last_clean":"2026-02-13T01:25:22.626690+0000","last_became_active":"2026-02-13T01:25:13.593871+0000","last_became_peered":"2026-02-13T01:25:13.593871+0000","last_unstale":"2026-02-13T01:25:22.626690+0000","last_undegraded":"2026-02-13T01:25:22.626690+0000","last_fullsized":"2026-02-13T01:25:22.626690+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:27.042093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'5","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633282+0000","last_change":"2026-02-13T01:25:12.587190+0000","last_active":"2026-02-13T01:25:22.633282+0000","last_peered":"2026-02-13T01:25:22.633282+0000","last_clean":"2026-02-13T01:25:22.633282+0000","last_became_active":"2026-02-13T01:25:12.586934+0000","last_became_peered":"2026-02-13T01:25:12.586934+0000","last_unstale":"2026-02-13T01:25:22.633282+0000","last_undegraded":"2026-02-13T01:25:22.633282+0000","last_fullsized":"2026-02-13T01:25:22.633282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:15:59.367266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628158+0000","last_change":"2026-02-13T01:25:13.597938+0000","last_active":"2026-02-13T01:25:22.628158+0000","last_peered":"2026-02-13T01:25:22.628158+0000","last_clean":"2026-02-13T01:25:22.628158+0000","last_became_active":"2026-02-13T01:25:13.597812+0000","last_became_peered":"2026-02-13T01:25:13.597812+0000","last_unstale":"2026-02-13T01:25:22.628158+0000","last_undegraded":"2026-02-13T01:25:22.628158+0000","last_fullsized":"2026-02-13T01:25:22.628158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:13.982549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626739+0000","last_change":"2026-02-13T01:25:12.585792+0000","last_active":"2026-02-13T01:25:22.626739+0000","last_peered":"2026-02-13T01:25:22.626739+0000","last_clean":"2026-02-13T01:25:22.626739+0000","last_became_active":"2026-02-13T01:25:12.584980+0000","last_became_peered":"2026-02-13T01:25:12.584980+0000","last_unstale":"2026-02-13T01:25:22.626739+0000","last_undegraded":"2026-02-13T01:25:22.626739+0000","last_fullsized":"2026-02-13T01:25:22.626739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:44.806719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628021+0000","last_change":"2026-02-13T01:25:13.597068+0000","last_active":"2026-02-13T01:25:22.628021+0000","last_peered":"2026-02-13T01:25:22.628021+0000","last_clean":"2026-02-13T01:25:22.628021+0000","last_became_active":"2026-02-13T01:25:13.596764+0000","last_became_peered":"2026-02-13T01:25:13.596764+0000","last_unstale":"2026-02-13T01:25:22.628021+0000","last_undegraded":"2026-02-13T01:25:22.628021+0000","last_fullsized":"2026-02-13T01:25:22.628021+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:57:04.619943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'6","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.616434+0000","last_change":"2026-02-13T01:25:12.587494+0000","last_active":"2026-02-13T01:25:23.616434+0000","last_peered":"2026-02-13T01:25:23.616434+0000","last_clean":"2026-02-13T01:25:23.616434+0000","last_became_active":"2026-02-13T01:25:12.587302+0000","last_became_peered":"2026-02-13T01:25:12.587302+0000","last_unstale":"2026-02-13T01:25:23.616434+0000","last_undegraded":"2026-02-13T01:25:23.616434+0000","last_fullsized":"2026-02-13T01:25:23.616434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:35.215432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628114+0000","last_change":"2026-02-13T01:25:13.599446+0000","last_active":"2026-02-13T01:25:22.628114+0000","last_peered":"2026-02-13T01:25:22.628114+0000","last_clean":"2026-02-13T01:25:22.628114+0000","last_became_active":"2026-02-13T01:25:13.599198+0000","last_became_peered":"2026-02-13T01:25:13.599198+0000","last_unstale":"2026-02-13T01:25:22.628114+0000","last_undegraded":"2026-02-13T01:25:22.628114+0000","last_fullsized":"2026-02-13T01:25:22.628114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:08:43.435619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":351,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627970+0000","last_change":"2026-02-13T01:24:51.184559+0000","last_active":"2026-02-13T01:25:22.627970+0000","last_peered":"2026-02-13T01:25:22.627970+0000","last_clean":"2026-02-13T01:25:22.627970+0000","last_became_active":"2026-02-13T01:24:51.184384+0000","last_became_peered":"2026-02-13T01:24:51.184384+0000","last_unstale":"2026-02-13T01:25:22.627970+0000","last_undegraded":"2026-02-13T01:25:22.627970+0000","last_fullsized":"2026-02-13T01:25:22.627970+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:23:51.893115+0000","last_clean_scrub_stamp":"2026-02-13T01:23:51.893115+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:29.993013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'6","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626593+0000","last_change":"2026-02-13T01:25:12.585065+0000","last_active":"2026-02-13T01:25:22.626593+0000","last_peered":"2026-02-13T01:25:22.626593+0000","last_clean":"2026-02-13T01:25:22.626593+0000","last_became_active":"2026-02-13T01:25:12.584714+0000","last_became_peered":"2026-02-13T01:25:12.584714+0000","last_unstale":"2026-02-13T01:25:22.626593+0000","last_undegraded":"2026-02-13T01:25:22.626593+0000","last_fullsized":"2026-02-13T01:25:22.626593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:42:38.385379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630001+0000","last_change":"2026-02-13T01:25:13.600026+0000","last_active":"2026-02-13T01:25:22.630001+0000","last_peered":"2026-02-13T01:25:22.630001+0000","last_clean":"2026-02-13T01:25:22.630001+0000","last_became_active":"2026-02-13T01:25:13.599911+0000","last_became_peered":"2026-02-13T01:25:13.599911+0000","last_unstale":"2026-02-13T01:25:22.630001+0000","last_undegraded":"2026-02-13T01:25:22.630001+0000","last_fullsized":"2026-02-13T01:25:22.630001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:24:32.272988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.627946+0000","last_change":"2026-02-13T01:25:12.586863+0000","last_active":"2026-02-13T01:25:22.627946+0000","last_peered":"2026-02-13T01:25:22.627946+0000","last_clean":"2026-02-13T01:25:22.627946+0000","last_became_active":"2026-02-13T01:25:12.586695+0000","last_became_peered":"2026-02-13T01:25:12.586695+0000","last_unstale":"2026-02-13T01:25:22.627946+0000","last_undegraded":"2026-02-13T01:25:22.627946+0000","last_fullsized":"2026-02-13T01:25:22.627946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:16:32.822119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633026+0000","last_change":"2026-02-13T01:25:13.596332+0000","last_active":"2026-02-13T01:25:22.633026+0000","last_peered":"2026-02-13T01:25:22.633026+0000","last_clean":"2026-02-13T01:25:22.633026+0000","last_became_active":"2026-02-13T01:25:13.596177+0000","last_became_peered":"2026-02-13T01:25:13.596177+0000","last_unstale":"2026-02-13T01:25:22.633026+0000","last_undegraded":"2026-02-13T01:25:22.633026+0000","last_fullsized":"2026-02-13T01:25:22.633026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:12.653773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'5","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.609120+0000","last_change":"2026-02-13T01:25:12.584951+0000","last_active":"2026-02-13T01:25:23.609120+0000","last_peered":"2026-02-13T01:25:23.609120+0000","last_clean":"2026-02-13T01:25:23.609120+0000","last_became_active":"2026-02-13T01:25:12.584782+0000","last_became_peered":"2026-02-13T01:25:12.584782+0000","last_unstale":"2026-02-13T01:25:23.609120+0000","last_undegraded":"2026-02-13T01:25:23.609120+0000","last_fullsized":"2026-02-13T01:25:23.609120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:50:10.145512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.631966+0000","last_change":"2026-02-13T01:25:22.631932+0000","last_active":"2026-02-13T01:25:22.631966+0000","last_peered":"2026-02-13T01:25:22.631966+0000","last_clean":"2026-02-13T01:25:22.631966+0000","last_became_active":"2026-02-13T01:25:22.631743+0000","last_became_peered":"2026-02-13T01:25:22.631743+0000","last_unstale":"2026-02-13T01:25:22.631966+0000","last_undegraded":"2026-02-13T01:25:22.631966+0000","last_fullsized":"2026-02-13T01:25:22.631966+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:45:57.457542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'5","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:24.630465+0000","last_change":"2026-02-13T01:25:12.585249+0000","last_active":"2026-02-13T01:25:24.630465+0000","last_peered":"2026-02-13T01:25:24.630465+0000","last_clean":"2026-02-13T01:25:24.630465+0000","last_became_active":"2026-02-13T01:25:12.584995+0000","last_became_peered":"2026-02-13T01:25:12.584995+0000","last_unstale":"2026-02-13T01:25:24.630465+0000","last_undegraded":"2026-02-13T01:25:24.630465+0000","last_fullsized":"2026-02-13T01:25:24.630465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:26.521420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626306+0000","last_change":"2026-02-13T01:25:13.599307+0000","last_active":"2026-02-13T01:25:22.626306+0000","last_peered":"2026-02-13T01:25:22.626306+0000","last_clean":"2026-02-13T01:25:22.626306+0000","last_became_active":"2026-02-13T01:25:13.599019+0000","last_became_peered":"2026-02-13T01:25:13.599019+0000","last_unstale":"2026-02-13T01:25:22.626306+0000","last_undegraded":"2026-02-13T01:25:22.626306+0000","last_fullsized":"2026-02-13T01:25:22.626306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:39.457930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"75'1","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.632006+0000","last_change":"2026-02-13T01:25:22.631969+0000","last_active":"2026-02-13T01:25:22.632006+0000","last_peered":"2026-02-13T01:25:22.632006+0000","last_clean":"2026-02-13T01:25:22.632006+0000","last_became_active":"2026-02-13T01:25:22.631746+0000","last_became_peered":"2026-02-13T01:25:22.631746+0000","last_unstale":"2026-02-13T01:25:22.632006+0000","last_undegraded":"2026-02-13T01:25:22.632006+0000","last_fullsized":"2026-02-13T01:25:22.632006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:41:38.492885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626295+0000","last_change":"2026-02-13T01:25:13.599386+0000","last_active":"2026-02-13T01:25:22.626295+0000","last_peered":"2026-02-13T01:25:22.626295+0000","last_clean":"2026-02-13T01:25:22.626295+0000","last_became_active":"2026-02-13T01:25:13.598797+0000","last_became_peered":"2026-02-13T01:25:13.598797+0000","last_unstale":"2026-02-13T01:25:22.626295+0000","last_undegraded":"2026-02-13T01:25:22.626295+0000","last_fullsized":"2026-02-13T01:25:22.626295+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:47:41.920834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626122+0000","last_change":"2026-02-13T01:25:12.584149+0000","last_active":"2026-02-13T01:25:22.626122+0000","last_peered":"2026-02-13T01:25:22.626122+0000","last_clean":"2026-02-13T01:25:22.626122+0000","last_became_active":"2026-02-13T01:25:12.583192+0000","last_became_peered":"2026-02-13T01:25:12.583192+0000","last_unstale":"2026-02-13T01:25:22.626122+0000","last_undegraded":"2026-02-13T01:25:22.626122+0000","last_fullsized":"2026-02-13T01:25:22.626122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:29:49.438788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.633306+0000","last_change":"2026-02-13T01:25:13.596354+0000","last_active":"2026-02-13T01:25:22.633306+0000","last_peered":"2026-02-13T01:25:22.633306+0000","last_clean":"2026-02-13T01:25:22.633306+0000","last_became_active":"2026-02-13T01:25:13.596192+0000","last_became_peered":"2026-02-13T01:25:13.596192+0000","last_unstale":"2026-02-13T01:25:22.633306+0000","last_undegraded":"2026-02-13T01:25:22.633306+0000","last_fullsized":"2026-02-13T01:25:22.633306+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:39:38.836223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629301+0000","last_change":"2026-02-13T01:25:12.588331+0000","last_active":"2026-02-13T01:25:22.629301+0000","last_peered":"2026-02-13T01:25:22.629301+0000","last_clean":"2026-02-13T01:25:22.629301+0000","last_became_active":"2026-02-13T01:25:12.588071+0000","last_became_peered":"2026-02-13T01:25:12.588071+0000","last_unstale":"2026-02-13T01:25:22.629301+0000","last_undegraded":"2026-02-13T01:25:22.629301+0000","last_fullsized":"2026-02-13T01:25:22.629301+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:35.866770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630136+0000","last_change":"2026-02-13T01:25:13.598530+0000","last_active":"2026-02-13T01:25:22.630136+0000","last_peered":"2026-02-13T01:25:22.630136+0000","last_clean":"2026-02-13T01:25:22.630136+0000","last_became_active":"2026-02-13T01:25:13.598219+0000","last_became_peered":"2026-02-13T01:25:13.598219+0000","last_unstale":"2026-02-13T01:25:22.630136+0000","last_undegraded":"2026-02-13T01:25:22.630136+0000","last_fullsized":"2026-02-13T01:25:22.630136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:28:20.723555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'7","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626543+0000","last_change":"2026-02-13T01:25:12.588841+0000","last_active":"2026-02-13T01:25:22.626543+0000","last_peered":"2026-02-13T01:25:22.626543+0000","last_clean":"2026-02-13T01:25:22.626543+0000","last_became_active":"2026-02-13T01:25:12.588740+0000","last_became_peered":"2026-02-13T01:25:12.588740+0000","last_unstale":"2026-02-13T01:25:22.626543+0000","last_undegraded":"2026-02-13T01:25:22.626543+0000","last_fullsized":"2026-02-13T01:25:22.626543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:35:24.749019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628971+0000","last_change":"2026-02-13T01:25:13.599374+0000","last_active":"2026-02-13T01:25:22.628971+0000","last_peered":"2026-02-13T01:25:22.628971+0000","last_clean":"2026-02-13T01:25:22.628971+0000","last_became_active":"2026-02-13T01:25:13.599203+0000","last_became_peered":"2026-02-13T01:25:13.599203+0000","last_unstale":"2026-02-13T01:25:22.628971+0000","last_undegraded":"2026-02-13T01:25:22.628971+0000","last_fullsized":"2026-02-13T01:25:22.628971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:17:22.788063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642589+0000","last_change":"2026-02-13T01:25:12.586929+0000","last_active":"2026-02-13T01:25:22.642589+0000","last_peered":"2026-02-13T01:25:22.642589+0000","last_clean":"2026-02-13T01:25:22.642589+0000","last_became_active":"2026-02-13T01:25:12.586784+0000","last_became_peered":"2026-02-13T01:25:12.586784+0000","last_unstale":"2026-02-13T01:25:22.642589+0000","last_undegraded":"2026-02-13T01:25:22.642589+0000","last_fullsized":"2026-02-13T01:25:22.642589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:20:42.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625620+0000","last_change":"2026-02-13T01:25:13.595662+0000","last_active":"2026-02-13T01:25:22.625620+0000","last_peered":"2026-02-13T01:25:22.625620+0000","last_clean":"2026-02-13T01:25:22.625620+0000","last_became_active":"2026-02-13T01:25:13.595175+0000","last_became_peered":"2026-02-13T01:25:13.595175+0000","last_unstale":"2026-02-13T01:25:22.625620+0000","last_undegraded":"2026-02-13T01:25:22.625620+0000","last_fullsized":"2026-02-13T01:25:22.625620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:55.804228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'7","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629894+0000","last_change":"2026-02-13T01:25:12.585367+0000","last_active":"2026-02-13T01:25:22.629894+0000","last_peered":"2026-02-13T01:25:22.629894+0000","last_clean":"2026-02-13T01:25:22.629894+0000","last_became_active":"2026-02-13T01:25:12.585130+0000","last_became_peered":"2026-02-13T01:25:12.585130+0000","last_unstale":"2026-02-13T01:25:22.629894+0000","last_undegraded":"2026-02-13T01:25:22.629894+0000","last_fullsized":"2026-02-13T01:25:22.629894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:05:40.260699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626549+0000","last_change":"2026-02-13T01:25:13.595087+0000","last_active":"2026-02-13T01:25:22.626549+0000","last_peered":"2026-02-13T01:25:22.626549+0000","last_clean":"2026-02-13T01:25:22.626549+0000","last_became_active":"2026-02-13T01:25:13.594916+0000","last_became_peered":"2026-02-13T01:25:13.594916+0000","last_unstale":"2026-02-13T01:25:22.626549+0000","last_undegraded":"2026-02-13T01:25:22.626549+0000","last_fullsized":"2026-02-13T01:25:22.626549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:22:33.449950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'3","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630333+0000","last_change":"2026-02-13T01:25:22.630139+0000","last_active":"2026-02-13T01:25:22.630333+0000","last_peered":"2026-02-13T01:25:22.630333+0000","last_clean":"2026-02-13T01:25:22.630333+0000","last_became_active":"2026-02-13T01:25:22.628480+0000","last_became_peered":"2026-02-13T01:25:22.628480+0000","last_unstale":"2026-02-13T01:25:22.630333+0000","last_undegraded":"2026-02-13T01:25:22.630333+0000","last_fullsized":"2026-02-13T01:25:22.630333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:26:56.853898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.629898+0000","last_change":"2026-02-13T01:25:13.597108+0000","last_active":"2026-02-13T01:25:22.629898+0000","last_peered":"2026-02-13T01:25:22.629898+0000","last_clean":"2026-02-13T01:25:22.629898+0000","last_became_active":"2026-02-13T01:25:13.596931+0000","last_became_peered":"2026-02-13T01:25:13.596931+0000","last_unstale":"2026-02-13T01:25:22.629898+0000","last_undegraded":"2026-02-13T01:25:22.629898+0000","last_fullsized":"2026-02-13T01:25:22.629898+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:17:57.428194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.643886+0000","last_change":"2026-02-13T01:25:22.643859+0000","last_active":"2026-02-13T01:25:22.643886+0000","last_peered":"2026-02-13T01:25:22.643886+0000","last_clean":"2026-02-13T01:25:22.643886+0000","last_became_active":"2026-02-13T01:25:22.642280+0000","last_became_peered":"2026-02-13T01:25:22.642280+0000","last_unstale":"2026-02-13T01:25:22.643886+0000","last_undegraded":"2026-02-13T01:25:22.643886+0000","last_fullsized":"2026-02-13T01:25:22.643886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:02.405845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628037+0000","last_change":"2026-02-13T01:25:13.599415+0000","last_active":"2026-02-13T01:25:22.628037+0000","last_peered":"2026-02-13T01:25:22.628037+0000","last_clean":"2026-02-13T01:25:22.628037+0000","last_became_active":"2026-02-13T01:25:13.599143+0000","last_became_peered":"2026-02-13T01:25:13.599143+0000","last_unstale":"2026-02-13T01:25:22.628037+0000","last_undegraded":"2026-02-13T01:25:22.628037+0000","last_fullsized":"2026-02-13T01:25:22.628037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:31.271789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626521+0000","last_change":"2026-02-13T01:25:13.600494+0000","last_active":"2026-02-13T01:25:22.626521+0000","last_peered":"2026-02-13T01:25:22.626521+0000","last_clean":"2026-02-13T01:25:22.626521+0000","last_became_active":"2026-02-13T01:25:13.600302+0000","last_became_peered":"2026-02-13T01:25:13.600302+0000","last_unstale":"2026-02-13T01:25:22.626521+0000","last_undegraded":"2026-02-13T01:25:22.626521+0000","last_fullsized":"2026-02-13T01:25:22.626521+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:50:25.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'5","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.625992+0000","last_change":"2026-02-13T01:25:12.584795+0000","last_active":"2026-02-13T01:25:22.625992+0000","last_peered":"2026-02-13T01:25:22.625992+0000","last_clean":"2026-02-13T01:25:22.625992+0000","last_became_active":"2026-02-13T01:25:12.584392+0000","last_became_peered":"2026-02-13T01:25:12.584392+0000","last_unstale":"2026-02-13T01:25:22.625992+0000","last_undegraded":"2026-02-13T01:25:22.625992+0000","last_fullsized":"2026-02-13T01:25:22.625992+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:47.018206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.642609+0000","last_change":"2026-02-13T01:25:13.600631+0000","last_active":"2026-02-13T01:25:22.642609+0000","last_peered":"2026-02-13T01:25:22.642609+0000","last_clean":"2026-02-13T01:25:22.642609+0000","last_became_active":"2026-02-13T01:25:13.599642+0000","last_became_peered":"2026-02-13T01:25:13.599642+0000","last_unstale":"2026-02-13T01:25:22.642609+0000","last_undegraded":"2026-02-13T01:25:22.642609+0000","last_fullsized":"2026-02-13T01:25:22.642609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:03:02.974206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'12","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.626019+0000","last_change":"2026-02-13T01:25:12.584754+0000","last_active":"2026-02-13T01:25:22.626019+0000","last_peered":"2026-02-13T01:25:22.626019+0000","last_clean":"2026-02-13T01:25:22.626019+0000","last_became_active":"2026-02-13T01:25:12.584425+0000","last_became_peered":"2026-02-13T01:25:12.584425+0000","last_unstale":"2026-02-13T01:25:22.626019+0000","last_undegraded":"2026-02-13T01:25:22.626019+0000","last_fullsized":"2026-02-13T01:25:22.626019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:32:08.183856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.628971+0000","last_change":"2026-02-13T01:25:13.602615+0000","last_active":"2026-02-13T01:25:22.628971+0000","last_peered":"2026-02-13T01:25:22.628971+0000","last_clean":"2026-02-13T01:25:22.628971+0000","last_became_active":"2026-02-13T01:25:13.602511+0000","last_became_peered":"2026-02-13T01:25:13.602511+0000","last_unstale":"2026-02-13T01:25:22.628971+0000","last_undegraded":"2026-02-13T01:25:22.628971+0000","last_fullsized":"2026-02-13T01:25:22.628971+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:27:59.716321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630144+0000","last_change":"2026-02-13T01:25:12.588038+0000","last_active":"2026-02-13T01:25:22.630144+0000","last_peered":"2026-02-13T01:25:22.630144+0000","last_clean":"2026-02-13T01:25:22.630144+0000","last_became_active":"2026-02-13T01:25:12.587814+0000","last_became_peered":"2026-02-13T01:25:12.587814+0000","last_unstale":"2026-02-13T01:25:22.630144+0000","last_undegraded":"2026-02-13T01:25:22.630144+0000","last_fullsized":"2026-02-13T01:25:22.630144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:21:56.420466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:22.630035+0000","last_change":"2026-02-13T01:25:13.598388+0000","last_active":"2026-02-13T01:25:22.630035+0000","last_peered":"2026-02-13T01:25:22.630035+0000","last_clean":"2026-02-13T01:25:22.630035+0000","last_became_active":"2026-02-13T01:25:13.598128+0000","last_became_peered":"2026-02-13T01:25:13.598128+0000","last_unstale":"2026-02-13T01:25:22.630035+0000","last_undegraded":"2026-02-13T01:25:22.630035+0000","last_fullsized":"2026-02-13T01:25:22.630035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:12.577867+0000","last_clean_scrub_stamp":"2026-02-13T01:25:12.577867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:15:42.080004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'13","reported_seq":60,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-13T01:25:23.630534+0000","last_change":"2026-02-13T01:25:22.633597+0000","last_active":"2026-02-13T01:25:23.630534+0000","last_peered":"2026-02-13T01:25:23.630534+0000","last_clean":"2026-02-13T01:25:23.630534+0000","last_became_active":"2026-02-13T01:25:22.629652+0000","last_became_peered":"2026-02-13T01:25:22.629652+0000","last_unstale":"2026-02-13T01:25:23.630534+0000","last_undegraded":"2026-02-13T01:25:23.630534+0000","last_fullsized":"2026-02-13T01:25:23.630534+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T01:25:11.575699+0000","last_clean_scrub_stamp":"2026-02-13T01:25:11.575699+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:30.389704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60606,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":99,"num_read_kb":115,"num_write":228,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":694,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":181818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":184685,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":300107,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710729,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":10,"kb_used_meta":26933,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":411969,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":10986,"internal_metadata":27579670},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939657,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27936,"kb_used_data":972,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975264,"statfs":{"total":751619276800,"available":751590670336,"internally_reserved":0,"allocated":995328,"data_stored":1055842,"data_compressed":43917,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":36137,"internal_metadata":27554519},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":411489,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":33529,"internal_metadata":27557127},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299404,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27804,"kb_used_data":840,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975396,"statfs":{"total":751619276800,"available":751590805504,"internally_reserved":0,"allocated":860160,"data_stored":411195,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":29269,"internal_metadata":27561387},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528335,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27864,"kb_used_data":900,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975336,"statfs":{"total":751619276800,"available":751590744064,"internally_reserved":0,"allocated":921600,"data_stored":1004836,"data_compressed":43917,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":33845,"internal_metadata":27556811},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":411184,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":36017,"internal_metadata":27554639},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888082,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27876,"kb_used_data":912,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975324,"statfs":{"total":751619276800,"available":751590731776,"internally_reserved":0,"allocated":933888,"data_stored":1004126,"data_compressed":43917,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":39724,"internal_metadata":27550932},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":412149,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":49090,"internal_metadata":27541566},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247828,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27816,"kb_used_data":852,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975384,"statfs":{"total":751619276800,"available":751590793216,"internally_reserved":0,"allocated":872448,"data_stored":411009,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":50373,"internal_metadata":27540283},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27872,"kb_used_data":908,"kb_used_omap":61,"kb_used_meta":26882,"kb_avail":733975328,"statfs":{"total":751619276800,"available":751590735872,"internally_reserved":0,"allocated":929792,"data_stored":466003,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":63032,"internal_metadata":27527624},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607574,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":464985,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":46972,"internal_metadata":27543684},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27820,"kb_used_data":856,"kb_used_omap":55,"kb_used_meta":26888,"kb_avail":733975380,"statfs":{"total":751619276800,"available":751590789120,"internally_reserved":0,"allocated":876544,"data_stored":412977,"data_compressed":5783,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":56402,"internal_metadata":27534254},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36479,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38134,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11444,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4883,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20956,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21037,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30728,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8292,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14625,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10390,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13650,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22332,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21894,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4454,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T01:25:28.156 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T01:25:28.156 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T01:25:28.156 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T01:25:28.156 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:28.306 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:28.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- 10.20.193.91:0/4131307485 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010fbf0 msgr2=0x7feeb0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/4131307485 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010fbf0 0x7feeb0114c30 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=1205724010060296624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee980099a0 tx=0x7fee9802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:28.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- 10.20.193.91:0/4131307485 shutdown_connections 2026-02-13T01:25:28.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/4131307485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feeb0115410 0x7feeb0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/4131307485 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010fbf0 0x7feeb0114c30 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=1205724010060296624 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/4131307485 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb010f200 0x7feeb010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- 10.20.193.91:0/4131307485 >> 10.20.193.91:0/4131307485 conn(0x7feeb00ecb00 msgr2=0x7feeb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- 10.20.193.91:0/4131307485 shutdown_connections 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- 10.20.193.91:0/4131307485 wait complete. 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 Processor -- start 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- start start 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 0x7feeb00f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feeb0115410 0x7feeb0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb00f5320 0x7feeb00fa5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00f5a10 con 0x7feeb010f200 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00fab30 con 0x7feeb0115410 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeb4c896c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7feeb00facf0 con 0x7feeb00f5320 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeae5756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 0x7feeb00f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeae5756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 0x7feeb00f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44956/0 (socket says 10.20.193.91:44956) 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeae5756c0 1 -- 10.20.193.91:0/2018961 learned_addr learned my addr 10.20.193.91:0/2018961 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeaed766c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb00f5320 0x7feeb00fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.417+0000 7feeadd746c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feeb0115410 0x7feeb0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeae5756c0 1 -- 10.20.193.91:0/2018961 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb00f5320 msgr2=0x7feeb00fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeae5756c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb00f5320 0x7feeb00fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeae5756c0 1 -- 10.20.193.91:0/2018961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feeb0115410 msgr2=0x7feeb0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeae5756c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feeb0115410 0x7feeb0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeae5756c0 1 -- 10.20.193.91:0/2018961 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee98009590 con 0x7feeb010f200 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeaed766c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb00f5320 0x7feeb00fa5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeae5756c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 0x7feeb00f4cf0 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feea4005dc0 tx=0x7feea400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feea4004250 con 0x7feeb010f200 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7feea4009070 con 0x7feeb010f200 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb00fafd0 con 0x7feeb010f200 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feea400cde0 con 0x7feeb010f200 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb00fb760 con 0x7feeb010f200 2026-02-13T01:25:28.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.418+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb01104d0 con 0x7feeb010f200 2026-02-13T01:25:28.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.420+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7feea40028c0 con 0x7feeb010f200 2026-02-13T01:25:28.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.421+0000 7fee977fe6c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fee880b5760 0x7fee880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:28.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.421+0000 7feeadd746c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fee880b5760 0x7fee880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:28.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.421+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7feea40e3ce0 con 0x7feeb010f200 2026-02-13T01:25:28.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.421+0000 7feeadd746c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fee880b5760 0x7fee880d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee98005b40 tx=0x7fee98005c20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:28.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.421+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feea40a6520 con 0x7feeb010f200 2026-02-13T01:25:28.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.540+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feeb00f5e40 con 0x7feeb010f200 2026-02-13T01:25:28.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.540+0000 7fee977fe6c0 1 -- 10.20.193.91:0/2018961 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feea40a96d0 con 0x7feeb010f200 2026-02-13T01:25:28.540 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:28.541 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:28.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fee880b5760 msgr2=0x7fee880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fee880b5760 0x7fee880d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee98005b40 tx=0x7fee98005c20 comp rx=0 tx=0).stop 2026-02-13T01:25:28.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 msgr2=0x7feeb00f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:28.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 0x7feeb00f4cf0 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feea4005dc0 tx=0x7feea400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 shutdown_connections 2026-02-13T01:25:28.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fee880b5760 0x7fee880d5c10 unknown :-1 s=CLOSED pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feeb00f5320 0x7feeb00fa5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feeb0115410 0x7feeb0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 --2- 10.20.193.91:0/2018961 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feeb010f200 0x7feeb00f4cf0 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:28.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 >> 10.20.193.91:0/2018961 conn(0x7feeb00ecb00 msgr2=0x7feeb010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:28.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 shutdown_connections 2026-02-13T01:25:28.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:28.541+0000 7feeb4c896c0 1 -- 10.20.193.91:0/2018961 wait complete. 2026-02-13T01:25:28.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:28 trial154 ceph-mon[27045]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:28.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:28 trial154 ceph-mon[27045]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:28.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:28 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2018961' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:28.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:28 trial091 ceph-mon[25068]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:28.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:28 trial091 ceph-mon[25068]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:28.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:28 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2018961' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:29.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:28 trial126 ceph-mon[26569]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:29.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:28 trial126 ceph-mon[26569]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T01:25:29.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:28 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2018961' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:29.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:29 trial154 ceph-mon[27045]: pgmap v186: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 27 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T01:25:29.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:29 trial091 ceph-mon[25068]: pgmap v186: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 27 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T01:25:30.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:29 trial126 ceph-mon[26569]: pgmap v186: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 27 op/s; 86 B/s, 1 objects/s recovering 2026-02-13T01:25:31.582 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:31.703 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:31.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/17610370 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4115410 msgr2=0x7f96a4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/17610370 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4115410 0x7f96a4175db0 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=15808185689310507023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f969800aa70 tx=0x7f969802fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/17610370 shutdown_connections 2026-02-13T01:25:31.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/17610370 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4115410 0x7f96a4175db0 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=15808185689310507023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/17610370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96a410fbf0 0x7f96a4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/17610370 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f96a410f200 0x7f96a410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/17610370 >> 10.20.193.91:0/17610370 conn(0x7f96a40ecb00 msgr2=0x7f96a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/17610370 shutdown_connections 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.819+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/17610370 wait complete. 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 Processor -- start 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 -- start start 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96a410f200 0x7f96a411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f96a4115410 0x7f96a411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 0x7f96a4123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f96a41235a0 con 0x7f96a4122b90 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f96a4123710 con 0x7f96a410f200 2026-02-13T01:25:31.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96a41238d0 con 0x7f96a4115410 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 0x7f96a4123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 0x7f96a4123030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44982/0 (socket says 10.20.193.91:44982) 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 -- 10.20.193.91:0/1378553303 learned_addr learned my addr 10.20.193.91:0/1378553303 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a2ffd6c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f96a4115410 0x7f96a411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 -- 10.20.193.91:0/1378553303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f96a4115410 msgr2=0x7f96a411d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f96a4115410 0x7f96a411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 -- 10.20.193.91:0/1378553303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96a410f200 msgr2=0x7f96a411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96a410f200 0x7f96a411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 -- 10.20.193.91:0/1378553303 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969800a660 con 0x7f96a4122b90 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a3fff6c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 0x7f96a4123030 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96980052a0 tx=0x7f96980052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9698003a30 con 0x7f96a4122b90 2026-02-13T01:25:31.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f96980057c0 con 0x7f96a4122b90 2026-02-13T01:25:31.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a4163d20 con 0x7f96a4122b90 2026-02-13T01:25:31.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9698038070 con 0x7f96a4122b90 2026-02-13T01:25:31.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.820+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a4164150 con 0x7f96a4122b90 2026-02-13T01:25:31.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.821+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a41104d0 con 0x7f96a4122b90 2026-02-13T01:25:31.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.822+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9698003b90 con 0x7f96a4122b90 2026-02-13T01:25:31.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.822+0000 7f96a0ff96c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96780b56e0 0x7f96780d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:31.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.822+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f9698109080 con 0x7f96a4122b90 2026-02-13T01:25:31.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.822+0000 7f96a37fe6c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96780b56e0 0x7f96780d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:31.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.822+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f96980cb8c0 con 0x7f96a4122b90 2026-02-13T01:25:31.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.823+0000 7f96a37fe6c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96780b56e0 0x7f96780d5b90 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9690004750 tx=0x7f96900096a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:31.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.939+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f96a411e3e0 con 0x7f96a4122b90 2026-02-13T01:25:31.940 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:31 trial091 ceph-mon[25068]: pgmap v187: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s; 77 B/s, 1 objects/s recovering 2026-02-13T01:25:31.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.940+0000 7f96a0ff96c0 1 -- 10.20.193.91:0/1378553303 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f96980cea70 con 0x7f96a4122b90 2026-02-13T01:25:31.941 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:31.941 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:31.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96780b56e0 msgr2=0x7f96780d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96780b56e0 0x7f96780d5b90 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9690004750 tx=0x7f96900096a0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 msgr2=0x7f96a4123030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 0x7f96a4123030 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96980052a0 tx=0x7f96980052d0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 shutdown_connections 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f96780b56e0 0x7f96780d5b90 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f96a4122b90 0x7f96a4123030 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f96a4115410 0x7f96a411d7d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 --2- 10.20.193.91:0/1378553303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96a410f200 0x7f96a411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 >> 10.20.193.91:0/1378553303 conn(0x7f96a40ecb00 msgr2=0x7f96a410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:31.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 shutdown_connections 2026-02-13T01:25:31.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:31.941+0000 7f96a9eb06c0 1 -- 10.20.193.91:0/1378553303 wait complete. 2026-02-13T01:25:31.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:31 trial154 ceph-mon[27045]: pgmap v187: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s; 77 B/s, 1 objects/s recovering 2026-02-13T01:25:32.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:31 trial126 ceph-mon[26569]: pgmap v187: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 18 op/s; 77 B/s, 1 objects/s recovering 2026-02-13T01:25:32.966 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:32 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1378553303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:32.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:32 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1378553303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:33.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:32 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1378553303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:33.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:33 trial154 ceph-mon[27045]: pgmap v188: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 18 op/s; 69 B/s, 0 objects/s recovering 2026-02-13T01:25:33.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:33 trial091 ceph-mon[25068]: pgmap v188: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 18 op/s; 69 B/s, 0 objects/s recovering 2026-02-13T01:25:34.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:33 trial126 ceph-mon[26569]: pgmap v188: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 9.2 KiB/s wr, 18 op/s; 69 B/s, 0 objects/s recovering 2026-02-13T01:25:34.981 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:35.099 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/1642866846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a4115410 msgr2=0x7fe1a4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/1642866846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a4115410 0x7fe1a4175db0 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=13205309255457732882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe19400a9b0 tx=0x7fe19402fd20 comp rx=0 tx=0).stop 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/1642866846 shutdown_connections 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/1642866846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a4115410 0x7fe1a4175db0 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=13205309255457732882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/1642866846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a410fbf0 0x7fe1a4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/1642866846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a410f200 0x7fe1a410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/1642866846 >> 10.20.193.91:0/1642866846 conn(0x7fe1a40ecb00 msgr2=0x7fe1a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/1642866846 shutdown_connections 2026-02-13T01:25:35.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.213+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/1642866846 wait complete. 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 Processor -- start 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 -- start start 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 0x7fe1a40f4b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a4115410 0x7fe1a4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a40f51c0 0x7fe1a40fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40f58b0 con 0x7fe1a410f200 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40fa9d0 con 0x7fe1a40f51c0 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40fab90 con 0x7fe1a4115410 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 0x7fe1a40f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 0x7fe1a40f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45012/0 (socket says 10.20.193.91:45012) 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 -- 10.20.193.91:0/2638295482 learned_addr learned my addr 10.20.193.91:0/2638295482 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:35.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a1d746c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a4115410 0x7fe1a4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 -- 10.20.193.91:0/2638295482 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a4115410 msgr2=0x7fe1a4175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a4115410 0x7fe1a4175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 -- 10.20.193.91:0/2638295482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a40f51c0 msgr2=0x7fe1a40fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a40f51c0 0x7fe1a40fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 -- 10.20.193.91:0/2638295482 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19400a5b0 con 0x7fe1a410f200 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a25756c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 0x7fe1a40f4b90 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe198005950 tx=0x7fe19800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe198004460 con 0x7fe1a410f200 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe1980045c0 con 0x7fe1a410f200 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a40fae70 con 0x7fe1a410f200 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe198003960 con 0x7fe1a410f200 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.214+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a40fb600 con 0x7fe1a410f200 2026-02-13T01:25:35.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.215+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a41104d0 con 0x7fe1a410f200 2026-02-13T01:25:35.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.216+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fe198003af0 con 0x7fe1a410f200 2026-02-13T01:25:35.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.217+0000 7fe18b7fe6c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe17c0b5760 0x7fe17c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:35.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.217+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fe1980e3cc0 con 0x7fe1a410f200 2026-02-13T01:25:35.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.217+0000 7fe1a1d746c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe17c0b5760 0x7fe17c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:35.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.217+0000 7fe1a1d746c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe17c0b5760 0x7fe17c0d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a40fb520 tx=0x7fe18c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:35.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.218+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe1980a6540 con 0x7fe1a410f200 2026-02-13T01:25:35.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.331+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe1a40f5ce0 con 0x7fe1a410f200 2026-02-13T01:25:35.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.331+0000 7fe18b7fe6c0 1 -- 10.20.193.91:0/2638295482 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe1980a96f0 con 0x7fe1a410f200 2026-02-13T01:25:35.332 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:35.332 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:35.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe17c0b5760 msgr2=0x7fe17c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe17c0b5760 0x7fe17c0d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a40fb520 tx=0x7fe18c009260 comp rx=0 tx=0).stop 2026-02-13T01:25:35.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 msgr2=0x7fe1a40f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:35.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 0x7fe1a40f4b90 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe198005950 tx=0x7fe19800bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 shutdown_connections 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe17c0b5760 0x7fe17c0d5c10 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a40f51c0 0x7fe1a40fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a4115410 0x7fe1a4175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 --2- 10.20.193.91:0/2638295482 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a410f200 0x7fe1a40f4b90 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 >> 10.20.193.91:0/2638295482 conn(0x7fe1a40ecb00 msgr2=0x7fe1a410d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 shutdown_connections 2026-02-13T01:25:35.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:35.332+0000 7fe1a8e386c0 1 -- 10.20.193.91:0/2638295482 wait complete. 2026-02-13T01:25:35.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:35 trial154 ceph-mon[27045]: pgmap v189: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 17 op/s; 58 B/s, 0 objects/s recovering 2026-02-13T01:25:35.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:35 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2638295482' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:35 trial091 ceph-mon[25068]: pgmap v189: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 17 op/s; 58 B/s, 0 objects/s recovering 2026-02-13T01:25:35.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:35 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2638295482' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:36.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:35 trial126 ceph-mon[26569]: pgmap v189: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 17 op/s; 58 B/s, 0 objects/s recovering 2026-02-13T01:25:36.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:35 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2638295482' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:37.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:37 trial154 ceph-mon[27045]: pgmap v190: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 57 B/s, 0 objects/s recovering 2026-02-13T01:25:37.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:37 trial091 ceph-mon[25068]: pgmap v190: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 57 B/s, 0 objects/s recovering 2026-02-13T01:25:38.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:37 trial126 ceph-mon[26569]: pgmap v190: 97 pgs: 97 active+clean; 648 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 11 op/s; 57 B/s, 0 objects/s recovering 2026-02-13T01:25:38.373 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:38.493 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:38.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 -- 10.20.193.91:0/437594463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc10cfa0 msgr2=0x7f00fc10d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 --2- 10.20.193.91:0/437594463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc10cfa0 0x7f00fc10d370 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=11844464261046285459 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e80099a0 tx=0x7f00e802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 -- 10.20.193.91:0/437594463 shutdown_connections 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 --2- 10.20.193.91:0/437594463 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00fc1131b0 0x7f00fc173b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 --2- 10.20.193.91:0/437594463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10d990 0x7f00fc1129d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 --2- 10.20.193.91:0/437594463 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc10cfa0 0x7f00fc10d370 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=11844464261046285459 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 -- 10.20.193.91:0/437594463 >> 10.20.193.91:0/437594463 conn(0x7f00fc0ea8e0 msgr2=0x7f00fc10acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 -- 10.20.193.91:0/437594463 shutdown_connections 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.615+0000 7f0101f486c0 1 -- 10.20.193.91:0/437594463 wait complete. 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 Processor -- start 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 -- start start 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10cfa0 0x7f00fc0eeb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 0x7f00fc173a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00fc0eadd0 0x7f00fc0eb250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0eb9e0 con 0x7f00fc1131b0 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0ebb50 con 0x7f00fc10cfa0 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0ff430 con 0x7f00fc0eadd0 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 0x7f00fc173a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 0x7f00fc173a50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:35340/0 (socket says 10.20.193.91:35340) 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 -- 10.20.193.91:0/1443636464 learned_addr learned my addr 10.20.193.91:0/1443636464 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00fb7fe6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10cfa0 0x7f00fc0eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00fbfff6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00fc0eadd0 0x7f00fc0eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 -- 10.20.193.91:0/1443636464 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00fc0eadd0 msgr2=0x7f00fc0eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00fc0eadd0 0x7f00fc0eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 -- 10.20.193.91:0/1443636464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10cfa0 msgr2=0x7f00fc0eeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10cfa0 0x7f00fc0eeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 -- 10.20.193.91:0/1443636464 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e8009590 con 0x7f00fc1131b0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00fb7fe6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10cfa0 0x7f00fc0eeb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00faffd6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 0x7f00fc173a50 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec005fd0 tx=0x7f00ec00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec004280 con 0x7f00fc1131b0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc0ff710 con 0x7f00fc1131b0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f00ec0043e0 con 0x7f00fc1131b0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00ec00ccd0 con 0x7f00fc1131b0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.616+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc0ffbf0 con 0x7f00fc1131b0 2026-02-13T01:25:38.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.617+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc10e270 con 0x7f00fc1131b0 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.618+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f00ec0026b0 con 0x7f00fc1131b0 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.618+0000 7f00f8ff96c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00d00b56e0 0x7f00d00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:38.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.618+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f00ec0e3db0 con 0x7f00fc1131b0 2026-02-13T01:25:38.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.618+0000 7f00fb7fe6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00d00b56e0 0x7f00d00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:38.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.619+0000 7f00fb7fe6c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00d00b56e0 0x7f00d00d5b90 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e8005b40 tx=0x7f00e8005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:38.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.619+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00ec0a65f0 con 0x7f00fc1131b0 2026-02-13T01:25:38.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.738+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00fc10d370 con 0x7f00fc1131b0 2026-02-13T01:25:38.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.738+0000 7f00f8ff96c0 1 -- 10.20.193.91:0/1443636464 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00ec0a97a0 con 0x7f00fc1131b0 2026-02-13T01:25:38.738 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:38.738 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00d00b56e0 msgr2=0x7f00d00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00d00b56e0 0x7f00d00d5b90 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00e8005b40 tx=0x7f00e8005c00 comp rx=0 tx=0).stop 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 msgr2=0x7f00fc173a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 0x7f00fc173a50 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00ec005fd0 tx=0x7f00ec00bca0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 shutdown_connections 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00d00b56e0 0x7f00d00d5b90 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00fc0eadd0 0x7f00fc0eb250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00fc1131b0 0x7f00fc173a50 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 --2- 10.20.193.91:0/1443636464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00fc10cfa0 0x7f00fc0eeb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:38.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 >> 10.20.193.91:0/1443636464 conn(0x7f00fc0ea8e0 msgr2=0x7f00fc10b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:38.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 shutdown_connections 2026-02-13T01:25:38.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:38.739+0000 7f0101f486c0 1 -- 10.20.193.91:0/1443636464 wait complete. 2026-02-13T01:25:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:39 trial154 ceph-mon[27045]: pgmap v191: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-13T01:25:39.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:39 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1443636464' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:39 trial091 ceph-mon[25068]: pgmap v191: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-13T01:25:39.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:39 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1443636464' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:40.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:39 trial126 ceph-mon[26569]: pgmap v191: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2026-02-13T01:25:40.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:39 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1443636464' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:41.781 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:41.902 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:41.925 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:41 trial091 ceph-mon[25068]: pgmap v192: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:41.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:41 trial154 ceph-mon[27045]: pgmap v192: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:42.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- 10.20.193.91:0/4243604887 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2644115410 msgr2=0x7f2644175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- 10.20.193.91:0/4243604887 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2644115410 0x7f2644175db0 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=8193780134104222771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f263400aa70 tx=0x7f263402fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- 10.20.193.91:0/4243604887 shutdown_connections 2026-02-13T01:25:42.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- 10.20.193.91:0/4243604887 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2644115410 0x7f2644175db0 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=8193780134104222771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- 10.20.193.91:0/4243604887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f264410fbf0 0x7f2644114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- 10.20.193.91:0/4243604887 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f264410f200 0x7f264410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- 10.20.193.91:0/4243604887 >> 10.20.193.91:0/4243604887 conn(0x7f26440ecb00 msgr2=0x7f264410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- 10.20.193.91:0/4243604887 shutdown_connections 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- 10.20.193.91:0/4243604887 wait complete. 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 Processor -- start 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- start start 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 0x7f26440f4b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2644115410 0x7f2644175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f26440f51c0 0x7f26440fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f26440f58b0 con 0x7f264410f200 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f26440fa9d0 con 0x7f26440f51c0 2026-02-13T01:25:42.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26492956c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26440fab90 con 0x7f2644115410 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f2642ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 0x7f26440f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f2642ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 0x7f26440f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:35356/0 (socket says 10.20.193.91:35356) 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f2642ffd6c0 1 -- 10.20.193.91:0/4053657311 learned_addr learned my addr 10.20.193.91:0/4053657311 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26427fc6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2644115410 0x7f2644175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.018+0000 7f26437fe6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f26440f51c0 0x7f26440fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2642ffd6c0 1 -- 10.20.193.91:0/4053657311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2644115410 msgr2=0x7f2644175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2642ffd6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2644115410 0x7f2644175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2642ffd6c0 1 -- 10.20.193.91:0/4053657311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f26440f51c0 msgr2=0x7f26440fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2642ffd6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f26440f51c0 0x7f26440fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2642ffd6c0 1 -- 10.20.193.91:0/4053657311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263400a660 con 0x7f264410f200 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2642ffd6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 0x7f26440f4b90 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2638005dc0 tx=0x7f263800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:42.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2638004250 con 0x7f264410f200 2026-02-13T01:25:42.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2638009070 con 0x7f264410f200 2026-02-13T01:25:42.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26440fae70 con 0x7f264410f200 2026-02-13T01:25:42.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f263800cde0 con 0x7f264410f200 2026-02-13T01:25:42.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26440fb300 con 0x7f264410f200 2026-02-13T01:25:42.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.019+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26441104d0 con 0x7f264410f200 2026-02-13T01:25:42.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.020+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f26380028c0 con 0x7f264410f200 2026-02-13T01:25:42.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.021+0000 7f2623fff6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f26180b56e0 0x7f26180d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:42.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.021+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f26380e3b90 con 0x7f264410f200 2026-02-13T01:25:42.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.021+0000 7f26427fc6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f26180b56e0 0x7f26180d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:42.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.021+0000 7f26427fc6c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f26180b56e0 0x7f26180d5b90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f262c006b60 tx=0x7f262c006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:42.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.021+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26380a63d0 con 0x7f264410f200 2026-02-13T01:25:42.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:41 trial126 ceph-mon[26569]: pgmap v192: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:42.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.138+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26440f5d40 con 0x7f264410f200 2026-02-13T01:25:42.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.138+0000 7f2623fff6c0 1 -- 10.20.193.91:0/4053657311 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f26380a9580 con 0x7f264410f200 2026-02-13T01:25:42.138 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:42.139 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:42.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f26180b56e0 msgr2=0x7f26180d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f26180b56e0 0x7f26180d5b90 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f262c006b60 tx=0x7f262c006af0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 msgr2=0x7f26440f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 0x7f26440f4b90 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2638005dc0 tx=0x7f263800bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 shutdown_connections 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f26180b56e0 0x7f26180d5b90 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f26440f51c0 0x7f26440fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2644115410 0x7f2644175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 --2- 10.20.193.91:0/4053657311 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f264410f200 0x7f26440f4b90 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 >> 10.20.193.91:0/4053657311 conn(0x7f26440ecb00 msgr2=0x7f264410d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 shutdown_connections 2026-02-13T01:25:42.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:42.139+0000 7f26492956c0 1 -- 10.20.193.91:0/4053657311 wait complete. 2026-02-13T01:25:42.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:42 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4053657311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:42.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:42 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4053657311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:43.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:42 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4053657311' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:43.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:43 trial154 ceph-mon[27045]: pgmap v193: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:43.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:43 trial091 ceph-mon[25068]: pgmap v193: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:44.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:43 trial126 ceph-mon[26569]: pgmap v193: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:45.180 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:45.302 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:45.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/1696339862 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3994115410 msgr2=0x7f3994175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/1696339862 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3994115410 0x7f3994175db0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=12369958343487721157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f399000aa70 tx=0x7f399002fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/1696339862 shutdown_connections 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/1696339862 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3994115410 0x7f3994175db0 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=12369958343487721157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/1696339862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f399410fbf0 0x7f3994114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/1696339862 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f399410f200 0x7f399410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/1696339862 >> 10.20.193.91:0/1696339862 conn(0x7f39940ecb00 msgr2=0x7f399410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/1696339862 shutdown_connections 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.421+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/1696339862 wait complete. 2026-02-13T01:25:45.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 Processor -- start 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 -- start start 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 0x7f399411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3994115410 0x7f399411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3994122b90 0x7f3994123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f39941235a0 con 0x7f399410f200 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3994123710 con 0x7f3994122b90 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39941238d0 con 0x7f3994115410 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 0x7f399411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 0x7f399411d290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:35364/0 (socket says 10.20.193.91:35364) 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 -- 10.20.193.91:0/3007150768 learned_addr learned my addr 10.20.193.91:0/3007150768 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f3998d3c6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3994115410 0x7f399411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 -- 10.20.193.91:0/3007150768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3994115410 msgr2=0x7f399411d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3994115410 0x7f399411d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 -- 10.20.193.91:0/3007150768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3994122b90 msgr2=0x7f3994123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3994122b90 0x7f3994123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 -- 10.20.193.91:0/3007150768 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399000a660 con 0x7f399410f200 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f3998d3c6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3994115410 0x7f399411d7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399953d6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 0x7f399411d290 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3984005dc0 tx=0x7f398400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3984004250 con 0x7f399410f200 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3984009070 con 0x7f399410f200 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3994163d80 con 0x7f399410f200 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f398400cd70 con 0x7f399410f200 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.422+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3994164210 con 0x7f399410f200 2026-02-13T01:25:45.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.423+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39941104d0 con 0x7f399410f200 2026-02-13T01:25:45.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.424+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f39840028c0 con 0x7f399410f200 2026-02-13T01:25:45.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.424+0000 7f39827fc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39700b5760 0x7f39700d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:45.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.424+0000 7f3998d3c6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39700b5760 0x7f39700d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:45.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.424+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f39840e3d60 con 0x7f399410f200 2026-02-13T01:25:45.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.425+0000 7f3998d3c6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39700b5760 0x7f39700d5c10 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3988005fd0 tx=0x7f3988005d50 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:45.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.425+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f39840a65a0 con 0x7f399410f200 2026-02-13T01:25:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.542+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f399410f5d0 con 0x7f399410f200 2026-02-13T01:25:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.542+0000 7f39827fc6c0 1 -- 10.20.193.91:0/3007150768 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f39840a9750 con 0x7f399410f200 2026-02-13T01:25:45.543 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:45.543 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39700b5760 msgr2=0x7f39700d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39700b5760 0x7f39700d5c10 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3988005fd0 tx=0x7f3988005d50 comp rx=0 tx=0).stop 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 msgr2=0x7f399411d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 0x7f399411d290 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3984005dc0 tx=0x7f398400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 shutdown_connections 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39700b5760 0x7f39700d5c10 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3994122b90 0x7f3994123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3994115410 0x7f399411d7d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 --2- 10.20.193.91:0/3007150768 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f399410f200 0x7f399411d290 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 >> 10.20.193.91:0/3007150768 conn(0x7f39940ecb00 msgr2=0x7f399410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 shutdown_connections 2026-02-13T01:25:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:45.543+0000 7f399b7cc6c0 1 -- 10.20.193.91:0/3007150768 wait complete. 2026-02-13T01:25:45.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:45 trial154 ceph-mon[27045]: pgmap v194: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T01:25:45.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:45 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3007150768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:45 trial091 ceph-mon[25068]: pgmap v194: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T01:25:45.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:45 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3007150768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:46.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:45 trial126 ceph-mon[26569]: pgmap v194: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T01:25:46.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:45 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3007150768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:47.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:47 trial154 ceph-mon[27045]: pgmap v195: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:47.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:47 trial091 ceph-mon[25068]: pgmap v195: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:48.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:47 trial126 ceph-mon[26569]: pgmap v195: 97 pgs: 97 active+clean; 652 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T01:25:48.586 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:48.708 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:48.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3878427032 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff12410cf80 msgr2=0x7ff12410d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3878427032 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff12410cf80 0x7ff12410d350 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=10355876694693116275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1140099a0 tx=0x7ff11402ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:48.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3878427032 shutdown_connections 2026-02-13T01:25:48.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3878427032 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff124113190 0x7ff124173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3878427032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410d970 0x7ff1241129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3878427032 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff12410cf80 0x7ff12410d350 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=10355876694693116275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3878427032 >> 10.20.193.91:0/3878427032 conn(0x7ff1240ea880 msgr2=0x7ff12410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3878427032 shutdown_connections 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3878427032 wait complete. 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 Processor -- start 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- start start 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410cf80 0x7ff1240f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff124113190 0x7ff124173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 0x7ff1240fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240f59b0 con 0x7ff1240f52c0 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240faad0 con 0x7ff12410cf80 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12c1496c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240fac90 con 0x7ff124113190 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 0x7ff1240fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 0x7ff1240fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:55510/0 (socket says 10.20.193.91:55510) 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 -- 10.20.193.91:0/3988887491 learned_addr learned my addr 10.20.193.91:0/3988887491 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff1296b96c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff124113190 0x7ff124173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 -- 10.20.193.91:0/3988887491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff124113190 msgr2=0x7ff124173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff124113190 0x7ff124173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff129eba6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410cf80 0x7ff1240f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 -- 10.20.193.91:0/3988887491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410cf80 msgr2=0x7ff1240f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410cf80 0x7ff1240f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 -- 10.20.193.91:0/3988887491 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff114009590 con 0x7ff1240f52c0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff129eba6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410cf80 0x7ff1240f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.828+0000 7ff12a6bb6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 0x7ff1240fa590 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff120006ea0 tx=0x7ff12000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.829+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff120003a30 con 0x7ff1240f52c0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.829+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff1200054f0 con 0x7ff1240f52c0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.829+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1240faf70 con 0x7ff1240f52c0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.829+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff12000dcd0 con 0x7ff1240f52c0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.829+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1240fb700 con 0x7ff1240f52c0 2026-02-13T01:25:48.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.829+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12410e250 con 0x7ff1240f52c0 2026-02-13T01:25:48.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.830+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff120003b90 con 0x7ff1240f52c0 2026-02-13T01:25:48.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.831+0000 7ff112ffd6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1000b5760 0x7ff1000d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:48.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.831+0000 7ff129eba6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1000b5760 0x7ff1000d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:48.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.831+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff1200e4d50 con 0x7ff1240f52c0 2026-02-13T01:25:48.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.831+0000 7ff129eba6c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1000b5760 0x7ff1000d5c10 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1140098c0 tx=0x7ff11402f580 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:48.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.831+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1200a7590 con 0x7ff1240f52c0 2026-02-13T01:25:48.947 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.947+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff12410d350 con 0x7ff1240f52c0 2026-02-13T01:25:48.947 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.947+0000 7ff112ffd6c0 1 -- 10.20.193.91:0/3988887491 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff12000de60 con 0x7ff1240f52c0 2026-02-13T01:25:48.948 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:48.948 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1000b5760 msgr2=0x7ff1000d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1000b5760 0x7ff1000d5c10 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1140098c0 tx=0x7ff11402f580 comp rx=0 tx=0).stop 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 msgr2=0x7ff1240fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 0x7ff1240fa590 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff120006ea0 tx=0x7ff12000cca0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 shutdown_connections 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1000b5760 0x7ff1000d5c10 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1240f52c0 0x7ff1240fa590 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff124113190 0x7ff124173a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.949 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 --2- 10.20.193.91:0/3988887491 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12410cf80 0x7ff1240f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:48.950 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 >> 10.20.193.91:0/3988887491 conn(0x7ff1240ea880 msgr2=0x7ff124111950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:48.950 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 shutdown_connections 2026-02-13T01:25:48.950 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:48.948+0000 7ff12c1496c0 1 -- 10.20.193.91:0/3988887491 wait complete. 2026-02-13T01:25:49.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:49 trial154 ceph-mon[27045]: pgmap v196: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-13T01:25:49.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:49 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3988887491' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:49.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:49 trial091 ceph-mon[25068]: pgmap v196: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-13T01:25:49.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:49 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3988887491' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:50.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:49 trial126 ceph-mon[26569]: pgmap v196: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-13T01:25:50.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:49 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3988887491' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:51.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:51 trial154 ceph-mon[27045]: pgmap v197: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T01:25:51.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:51 trial091 ceph-mon[25068]: pgmap v197: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T01:25:51.990 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:52.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:51 trial126 ceph-mon[26569]: pgmap v197: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T01:25:52.109 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.218+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/3691891675 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd810fc20 msgr2=0x7f7dd8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.218+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/3691891675 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd810fc20 0x7f7dd8114c60 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=4471437277879372662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc00099a0 tx=0x7f7dc002ed50 comp rx=0 tx=0).stop 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/3691891675 shutdown_connections 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/3691891675 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7dd8115440 0x7f7dd8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/3691891675 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd810fc20 0x7f7dd8114c60 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=4471437277879372662 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/3691891675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd810f230 0x7f7dd810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/3691891675 >> 10.20.193.91:0/3691891675 conn(0x7f7dd80ecb30 msgr2=0x7f7dd810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/3691891675 shutdown_connections 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/3691891675 wait complete. 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 Processor -- start 2026-02-13T01:25:52.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- start start 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd810f230 0x7f7dd80f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 0x7f7dd8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7dd80f5310 0x7f7dd80fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd80f5a00 con 0x7f7dd8115440 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd80faad0 con 0x7f7dd810f230 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd80fac90 con 0x7f7dd80f5310 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 0x7f7dd8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 0x7f7dd8175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:55532/0 (socket says 10.20.193.91:55532) 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 -- 10.20.193.91:0/662066302 learned_addr learned my addr 10.20.193.91:0/662066302 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddce826c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd810f230 0x7f7dd80f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddd6836c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7dd80f5310 0x7f7dd80fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 -- 10.20.193.91:0/662066302 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7dd80f5310 msgr2=0x7f7dd80fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7dd80f5310 0x7f7dd80fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 -- 10.20.193.91:0/662066302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd810f230 msgr2=0x7f7dd80f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd810f230 0x7f7dd80f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 -- 10.20.193.91:0/662066302 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc0009590 con 0x7f7dd8115440 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcffff6c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 0x7f7dd8175ce0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc00023a0 tx=0x7f7dc002fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dc0002ae0 con 0x7f7dd8115440 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7dc0002c40 con 0x7f7dd8115440 2026-02-13T01:25:52.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd80faf10 con 0x7f7dd8115440 2026-02-13T01:25:52.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dc00372f0 con 0x7f7dd8115440 2026-02-13T01:25:52.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.219+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd80fb3e0 con 0x7f7dd8115440 2026-02-13T01:25:52.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.220+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd8110500 con 0x7f7dd8115440 2026-02-13T01:25:52.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.221+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7dc00071c0 con 0x7f7dd8115440 2026-02-13T01:25:52.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.222+0000 7f7dcdffb6c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7db40b5760 0x7f7db40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:52.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.222+0000 7f7ddce826c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7db40b5760 0x7f7db40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:52.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.222+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7dc0107f20 con 0x7f7dd8115440 2026-02-13T01:25:52.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.222+0000 7f7ddce826c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7db40b5760 0x7f7db40d5c10 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc8005dc0 tx=0x7f7dc8005d10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:52.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.222+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7dc00ca760 con 0x7f7dd8115440 2026-02-13T01:25:52.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.341+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7dd810f600 con 0x7f7dd8115440 2026-02-13T01:25:52.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.341+0000 7f7dcdffb6c0 1 -- 10.20.193.91:0/662066302 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7dc0002db0 con 0x7f7dd8115440 2026-02-13T01:25:52.341 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:52.341 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7db40b5760 msgr2=0x7f7db40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7db40b5760 0x7f7db40d5c10 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc8005dc0 tx=0x7f7dc8005d10 comp rx=0 tx=0).stop 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 msgr2=0x7f7dd8175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 0x7f7dd8175ce0 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dc00023a0 tx=0x7f7dc002fbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 shutdown_connections 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7db40b5760 0x7f7db40d5c10 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7dd80f5310 0x7f7dd80fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7dd8115440 0x7f7dd8175ce0 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 --2- 10.20.193.91:0/662066302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd810f230 0x7f7dd80f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 >> 10.20.193.91:0/662066302 conn(0x7f7dd80ecb30 msgr2=0x7f7dd810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 shutdown_connections 2026-02-13T01:25:52.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:52.342+0000 7f7ddf1116c0 1 -- 10.20.193.91:0/662066302 wait complete. 2026-02-13T01:25:52.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:52 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/662066302' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:52.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:52 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/662066302' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:53.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:52 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/662066302' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:53.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:53 trial154 ceph-mon[27045]: pgmap v198: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T01:25:53.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:53 trial091 ceph-mon[25068]: pgmap v198: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T01:25:54.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:53 trial126 ceph-mon[26569]: pgmap v198: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T01:25:55.382 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:55.501 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/4166091401 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410fbf0 msgr2=0x7f0a04114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/4166091401 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410fbf0 0x7f0a04114c30 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=2664453060828191716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09f80099a0 tx=0x7f09f802ed20 comp rx=0 tx=0).stop 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/4166091401 shutdown_connections 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/4166091401 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a04115410 0x7f0a04175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/4166091401 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410fbf0 0x7f0a04114c30 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=2664453060828191716 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/4166091401 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a0410f200 0x7f0a0410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/4166091401 >> 10.20.193.91:0/4166091401 conn(0x7f0a040ecb00 msgr2=0x7f0a0410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/4166091401 shutdown_connections 2026-02-13T01:25:55.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.617+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/4166091401 wait complete. 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 Processor -- start 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 -- start start 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 0x7f0a040f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a04115410 0x7f0a04175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a040f52c0 0x7f0a040fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0a040f59b0 con 0x7f0a0410f200 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0a040faad0 con 0x7f0a04115410 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a040fac90 con 0x7f0a040f52c0 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 0x7f0a040f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 0x7f0a040f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:55546/0 (socket says 10.20.193.91:55546) 2026-02-13T01:25:55.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 -- 10.20.193.91:0/2747272625 learned_addr learned my addr 10.20.193.91:0/2747272625 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a094b56c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a04115410 0x7f0a04175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0a4b76c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a040f52c0 0x7f0a040fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 -- 10.20.193.91:0/2747272625 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a040f52c0 msgr2=0x7f0a040fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a040f52c0 0x7f0a040fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 -- 10.20.193.91:0/2747272625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a04115410 msgr2=0x7f0a04175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a04115410 0x7f0a04175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 -- 10.20.193.91:0/2747272625 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f8009590 con 0x7f0a0410f200 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a094b56c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a04115410 0x7f0a04175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0a4b76c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a040f52c0 0x7f0a040fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a09cb66c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 0x7f0a040f4c90 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09f400b710 tx=0x7f09f400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:55.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09f4004250 con 0x7f0a0410f200 2026-02-13T01:25:55.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f09f4009070 con 0x7f0a0410f200 2026-02-13T01:25:55.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a040faf70 con 0x7f0a0410f200 2026-02-13T01:25:55.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09f400ccd0 con 0x7f0a0410f200 2026-02-13T01:25:55.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.618+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a040fb700 con 0x7f0a0410f200 2026-02-13T01:25:55.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.619+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a041104d0 con 0x7f0a0410f200 2026-02-13T01:25:55.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.620+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f09f40028c0 con 0x7f0a0410f200 2026-02-13T01:25:55.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.621+0000 7f09f2ffd6c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f09e00b5760 0x7f09e00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:55.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.621+0000 7f0a094b56c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f09e00b5760 0x7f09e00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:55.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.621+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f09f40e3e20 con 0x7f0a0410f200 2026-02-13T01:25:55.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.621+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f09f40e4310 con 0x7f0a0410f200 2026-02-13T01:25:55.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.621+0000 7f0a094b56c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f09e00b5760 0x7f09e00d5c10 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09f80092e0 tx=0x7f09f8005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:55.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.735+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0a0410f5d0 con 0x7f0a0410f200 2026-02-13T01:25:55.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.735+0000 7f09f2ffd6c0 1 -- 10.20.193.91:0/2747272625 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f09f40a66a0 con 0x7f0a0410f200 2026-02-13T01:25:55.735 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:55.735 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:55.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f09e00b5760 msgr2=0x7f09e00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f09e00b5760 0x7f09e00d5c10 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09f80092e0 tx=0x7f09f8005c00 comp rx=0 tx=0).stop 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 msgr2=0x7f0a040f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 0x7f0a040f4c90 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09f400b710 tx=0x7f09f400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 shutdown_connections 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f09e00b5760 0x7f09e00d5c10 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0a040f52c0 0x7f0a040fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a04115410 0x7f0a04175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 --2- 10.20.193.91:0/2747272625 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0a0410f200 0x7f0a040f4c90 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 >> 10.20.193.91:0/2747272625 conn(0x7f0a040ecb00 msgr2=0x7f0a04113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 shutdown_connections 2026-02-13T01:25:55.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:55.737+0000 7f0a0bf456c0 1 -- 10.20.193.91:0/2747272625 wait complete. 2026-02-13T01:25:55.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:55 trial154 ceph-mon[27045]: pgmap v199: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 11 op/s 2026-02-13T01:25:55.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:55 trial091 ceph-mon[25068]: pgmap v199: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 11 op/s 2026-02-13T01:25:56.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:55 trial126 ceph-mon[26569]: pgmap v199: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 11 op/s 2026-02-13T01:25:56.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:56 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2747272625' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:56.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2747272625' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:56.999 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:56 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2747272625' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:57.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:57 trial154 ceph-mon[27045]: pgmap v200: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:25:57.977 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:57 trial091 ceph-mon[25068]: pgmap v200: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:25:58.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:57 trial126 ceph-mon[26569]: pgmap v200: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:25:58.779 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:25:58.895 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:25:59.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3661522515 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd10113190 msgr2=0x7fcd10173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3661522515 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd10113190 0x7fcd10173b30 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=4967381242980639111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd0c00aa70 tx=0x7fcd0c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3661522515 shutdown_connections 2026-02-13T01:25:59.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3661522515 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd10113190 0x7fcd10173b30 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=4967381242980639111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3661522515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd1010d970 0x7fcd101129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3661522515 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd1010cf80 0x7fcd1010d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3661522515 >> 10.20.193.91:0/3661522515 conn(0x7fcd100ea880 msgr2=0x7fcd1010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3661522515 shutdown_connections 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.007+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3661522515 wait complete. 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 Processor -- start 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 -- start start 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 0x7fcd10060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd10113190 0x7fcd10060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd10061180 0x7fcd101631f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10163730 con 0x7fcd1010cf80 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101638a0 con 0x7fcd10113190 2026-02-13T01:25:59.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10163a60 con 0x7fcd10061180 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 0x7fcd10060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 0x7fcd10060700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:56074/0 (socket says 10.20.193.91:56074) 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 -- 10.20.193.91:0/3252862511 learned_addr learned my addr 10.20.193.91:0/3252862511 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd157486c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd10113190 0x7fcd10060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd1674a6c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd10061180 0x7fcd101631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 -- 10.20.193.91:0/3252862511 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd10061180 msgr2=0x7fcd101631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd10061180 0x7fcd101631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 -- 10.20.193.91:0/3252862511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd10113190 msgr2=0x7fcd10060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd10113190 0x7fcd10060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 -- 10.20.193.91:0/3252862511 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd0c00a660 con 0x7fcd1010cf80 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd15f496c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 0x7fcd10060700 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd00009490 tx=0x7fcd0000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:59.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd00004a80 con 0x7fcd1010cf80 2026-02-13T01:25:59.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcd00009030 con 0x7fcd1010cf80 2026-02-13T01:25:59.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd10163d40 con 0x7fcd1010cf80 2026-02-13T01:25:59.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd0000cdd0 con 0x7fcd1010cf80 2026-02-13T01:25:59.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.008+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd10164220 con 0x7fcd1010cf80 2026-02-13T01:25:59.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.009+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1010e250 con 0x7fcd1010cf80 2026-02-13T01:25:59.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.010+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fcd00005000 con 0x7fcd1010cf80 2026-02-13T01:25:59.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.011+0000 7fccfeffd6c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fccec0b5760 0x7fccec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:25:59.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.011+0000 7fcd157486c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fccec0b5760 0x7fccec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:25:59.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.011+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fcd000e3d40 con 0x7fcd1010cf80 2026-02-13T01:25:59.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.011+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcd000a9590 con 0x7fcd1010cf80 2026-02-13T01:25:59.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.011+0000 7fcd157486c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fccec0b5760 0x7fccec0d5c10 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd04005980 tx=0x7fcd04005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:25:59.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.124+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd10061a00 con 0x7fcd1010cf80 2026-02-13T01:25:59.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.124+0000 7fccfeffd6c0 1 -- 10.20.193.91:0/3252862511 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcd000a9770 con 0x7fcd1010cf80 2026-02-13T01:25:59.124 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:25:59.124 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:25:59.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fccec0b5760 msgr2=0x7fccec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fccec0b5760 0x7fccec0d5c10 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd04005980 tx=0x7fcd04005910 comp rx=0 tx=0).stop 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 msgr2=0x7fcd10060700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 0x7fcd10060700 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd00009490 tx=0x7fcd0000bc50 comp rx=0 tx=0).stop 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 shutdown_connections 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fccec0b5760 0x7fccec0d5c10 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fcd10061180 0x7fcd101631f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd10113190 0x7fcd10060c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 --2- 10.20.193.91:0/3252862511 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fcd1010cf80 0x7fcd10060700 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 >> 10.20.193.91:0/3252862511 conn(0x7fcd100ea880 msgr2=0x7fcd1010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.125+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 shutdown_connections 2026-02-13T01:25:59.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:25:59.126+0000 7fcd181d46c0 1 -- 10.20.193.91:0/3252862511 wait complete. 2026-02-13T01:25:59.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:59 trial154 ceph-mon[27045]: pgmap v201: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:25:59.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:25:59 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3252862511' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:25:59.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:59 trial091 ceph-mon[25068]: pgmap v201: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:25:59.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:25:59 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3252862511' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:00.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:59 trial126 ceph-mon[26569]: pgmap v201: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:26:00.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:25:59 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3252862511' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:01.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:01 trial154 ceph-mon[27045]: pgmap v202: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:01.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:01 trial091 ceph-mon[25068]: pgmap v202: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:02.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:01 trial126 ceph-mon[26569]: pgmap v202: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:02.168 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:02.286 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:02.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 -- 10.20.193.91:0/394366163 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e010f230 msgr2=0x7f77e010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:02.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 --2- 10.20.193.91:0/394366163 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e010f230 0x7f77e010f600 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=2419078578860659293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d40099a0 tx=0x7f77d402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:02.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 -- 10.20.193.91:0/394366163 shutdown_connections 2026-02-13T01:26:02.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 --2- 10.20.193.91:0/394366163 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77e0115440 0x7f77e0175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 --2- 10.20.193.91:0/394366163 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77e010fc20 0x7f77e0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 --2- 10.20.193.91:0/394366163 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e010f230 0x7f77e010f600 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=2419078578860659293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.403+0000 7f77e51986c0 1 -- 10.20.193.91:0/394366163 >> 10.20.193.91:0/394366163 conn(0x7f77e00ecb30 msgr2=0x7f77e010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- 10.20.193.91:0/394366163 shutdown_connections 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- 10.20.193.91:0/394366163 wait complete. 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 Processor -- start 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- start start 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77e010f230 0x7f77e011d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77e0115440 0x7f77e011d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 0x7f77e0123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0123690 con 0x7f77e0122cb0 2026-02-13T01:26:02.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0123800 con 0x7f77e0115440 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01239c0 con 0x7f77e010f230 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 0x7f77e0123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 0x7f77e0123150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:56098/0 (socket says 10.20.193.91:56098) 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 -- 10.20.193.91:0/2411199069 learned_addr learned my addr 10.20.193.91:0/2411199069 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77ded766c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77e010f230 0x7f77e011d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77de5756c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77e0115440 0x7f77e011d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 -- 10.20.193.91:0/2411199069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77e010f230 msgr2=0x7f77e011d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77e010f230 0x7f77e011d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 -- 10.20.193.91:0/2411199069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77e0115440 msgr2=0x7f77e011d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77e0115440 0x7f77e011d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 -- 10.20.193.91:0/2411199069 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d4009590 con 0x7f77e0122cb0 2026-02-13T01:26:02.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77df5776c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 0x7f77e0123150 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d0006ea0 tx=0x7f77d000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:02.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77d0003a30 con 0x7f77e0122cb0 2026-02-13T01:26:02.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f77d00054f0 con 0x7f77e0122cb0 2026-02-13T01:26:02.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e0163e40 con 0x7f77e0122cb0 2026-02-13T01:26:02.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77d000dcd0 con 0x7f77e0122cb0 2026-02-13T01:26:02.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.404+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e0164320 con 0x7f77e0122cb0 2026-02-13T01:26:02.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.405+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e0110500 con 0x7f77e0122cb0 2026-02-13T01:26:02.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.406+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f77d0005030 con 0x7f77e0122cb0 2026-02-13T01:26:02.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.407+0000 7f77bffff6c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b40b5760 0x7f77b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:02.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.407+0000 7f77ded766c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b40b5760 0x7f77b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:02.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.407+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f77d00e4dd0 con 0x7f77e0122cb0 2026-02-13T01:26:02.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.407+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77d00a7610 con 0x7f77e0122cb0 2026-02-13T01:26:02.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.407+0000 7f77ded766c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b40b5760 0x7f77b40d5c10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d40092e0 tx=0x7f77d4005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:02.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.523+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77e011e500 con 0x7f77e0122cb0 2026-02-13T01:26:02.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.524+0000 7f77bffff6c0 1 -- 10.20.193.91:0/2411199069 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f77d00aa7c0 con 0x7f77e0122cb0 2026-02-13T01:26:02.523 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:02.523 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:02.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b40b5760 msgr2=0x7f77b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b40b5760 0x7f77b40d5c10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d40092e0 tx=0x7f77d4005c00 comp rx=0 tx=0).stop 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 msgr2=0x7f77e0123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 0x7f77e0123150 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77d0006ea0 tx=0x7f77d000cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 shutdown_connections 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b40b5760 0x7f77b40d5c10 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77e0122cb0 0x7f77e0123150 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77e0115440 0x7f77e011d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 --2- 10.20.193.91:0/2411199069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77e010f230 0x7f77e011d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 >> 10.20.193.91:0/2411199069 conn(0x7f77e00ecb30 msgr2=0x7f77e010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 shutdown_connections 2026-02-13T01:26:02.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:02.525+0000 7f77e51986c0 1 -- 10.20.193.91:0/2411199069 wait complete. 2026-02-13T01:26:02.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:02 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2411199069' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:02.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:02 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2411199069' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:03.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:02 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2411199069' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:03.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:03 trial154 ceph-mon[27045]: pgmap v203: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:03.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:03 trial091 ceph-mon[25068]: pgmap v203: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:04.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:03 trial126 ceph-mon[26569]: pgmap v203: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:05.566 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:05.686 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:05.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/3727104121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b54066ce0 msgr2=0x7f6b540670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/3727104121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b54066ce0 0x7f6b540670b0 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=11481555131495942391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b44009970 tx=0x7f6b4402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/3727104121 shutdown_connections 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/3727104121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 0x7f6b54179f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/3727104121 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b540675f0 0x7f6b541595e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/3727104121 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b54066ce0 0x7f6b540670b0 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=11481555131495942391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/3727104121 >> 10.20.193.91:0/3727104121 conn(0x7f6b54064810 msgr2=0x7f6b54064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/3727104121 shutdown_connections 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/3727104121 wait complete. 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 Processor -- start 2026-02-13T01:26:05.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- start start 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b54066ce0 0x7f6b541659b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 0x7f6b54165ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 0x7f6b5416b2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5416b900 con 0x7f6b540675f0 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5416ba70 con 0x7f6b54159b20 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b5b8886c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5416bc30 con 0x7f6b54066ce0 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.803+0000 7f6b58df86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 0x7f6b54165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 0x7f6b54165ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:56126/0 (socket says 10.20.193.91:56126) 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 -- 10.20.193.91:0/4012704787 learned_addr learned my addr 10.20.193.91:0/4012704787 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b59dfa6c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 0x7f6b5416b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b595f96c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b54066ce0 0x7f6b541659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:05.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 -- 10.20.193.91:0/4012704787 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b54066ce0 msgr2=0x7f6b541659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b54066ce0 0x7f6b541659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 -- 10.20.193.91:0/4012704787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 msgr2=0x7f6b5416b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 0x7f6b5416b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 -- 10.20.193.91:0/4012704787 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b44009590 con 0x7f6b540675f0 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b59dfa6c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 0x7f6b5416b2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b595f96c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b54066ce0 0x7f6b541659b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b58df86c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 0x7f6b54165ef0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b4800b710 tx=0x7f6b4800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b48004250 con 0x7f6b540675f0 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5416bf10 con 0x7f6b540675f0 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6b48009070 con 0x7f6b540675f0 2026-02-13T01:26:05.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b4800ccd0 con 0x7f6b540675f0 2026-02-13T01:26:05.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b54155750 con 0x7f6b540675f0 2026-02-13T01:26:05.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.804+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b540681f0 con 0x7f6b540675f0 2026-02-13T01:26:05.808 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:05 trial091 ceph-mon[25068]: pgmap v204: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 10 op/s 2026-02-13T01:26:05.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.806+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f6b480028c0 con 0x7f6b540675f0 2026-02-13T01:26:05.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.807+0000 7f6b427fc6c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6b300b56e0 0x7f6b300d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:05.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.807+0000 7f6b595f96c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6b300b56e0 0x7f6b300d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:05.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.807+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f6b480e3ee0 con 0x7f6b540675f0 2026-02-13T01:26:05.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.807+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6b480a96f0 con 0x7f6b540675f0 2026-02-13T01:26:05.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.807+0000 7f6b595f96c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6b300b56e0 0x7f6b300d5b90 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b44005b40 tx=0x7f6b440091c0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.924+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b54166b00 con 0x7f6b540675f0 2026-02-13T01:26:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b427fc6c0 1 -- 10.20.193.91:0/4012704787 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6b480a98d0 con 0x7f6b540675f0 2026-02-13T01:26:05.925 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:05.925 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6b300b56e0 msgr2=0x7f6b300d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6b300b56e0 0x7f6b300d5b90 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b44005b40 tx=0x7f6b440091c0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 msgr2=0x7f6b54165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 0x7f6b54165ef0 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b4800b710 tx=0x7f6b4800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 shutdown_connections 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6b300b56e0 0x7f6b300d5b90 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b54159b20 0x7f6b5416b2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6b540675f0 0x7f6b54165ef0 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 --2- 10.20.193.91:0/4012704787 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6b54066ce0 0x7f6b541659b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.925+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 >> 10.20.193.91:0/4012704787 conn(0x7f6b54064810 msgr2=0x7f6b54160190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.926+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 shutdown_connections 2026-02-13T01:26:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:05.926+0000 7f6b5b8886c0 1 -- 10.20.193.91:0/4012704787 wait complete. 2026-02-13T01:26:05.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:05 trial154 ceph-mon[27045]: pgmap v204: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 10 op/s 2026-02-13T01:26:06.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:05 trial126 ceph-mon[26569]: pgmap v204: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 10 op/s 2026-02-13T01:26:06.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:06 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4012704787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:06.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:06 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4012704787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:07.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:06 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4012704787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:07.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:07 trial154 ceph-mon[27045]: pgmap v205: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T01:26:07.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:07 trial091 ceph-mon[25068]: pgmap v205: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T01:26:08.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:07 trial126 ceph-mon[26569]: pgmap v205: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T01:26:08.966 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:09.087 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:09.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 -- 10.20.193.91:0/2446222914 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f511010d9a0 msgr2=0x7f51101129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:09.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 --2- 10.20.193.91:0/2446222914 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f511010d9a0 0x7f51101129e0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=2287243025675300058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51040099a0 tx=0x7f510402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:09.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 -- 10.20.193.91:0/2446222914 shutdown_connections 2026-02-13T01:26:09.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 --2- 10.20.193.91:0/2446222914 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51101131c0 0x7f5110173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 --2- 10.20.193.91:0/2446222914 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f511010d9a0 0x7f51101129e0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=2287243025675300058 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 --2- 10.20.193.91:0/2446222914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f511010cfb0 0x7f511010d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 -- 10.20.193.91:0/2446222914 >> 10.20.193.91:0/2446222914 conn(0x7f51100ea8b0 msgr2=0x7f511010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 -- 10.20.193.91:0/2446222914 shutdown_connections 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.207+0000 7f51185846c0 1 -- 10.20.193.91:0/2446222914 wait complete. 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 Processor -- start 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 -- start start 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f511010cfb0 0x7f51100f2a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51101131c0 0x7f5110173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 0x7f51100f8340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f51100f3760 con 0x7f51100f3070 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f51100f8880 con 0x7f511010cfb0 2026-02-13T01:26:09.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51100f8a40 con 0x7f51101131c0 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 0x7f51100f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 0x7f51100f8340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:41862/0 (socket says 10.20.193.91:41862) 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 -- 10.20.193.91:0/2698862424 learned_addr learned my addr 10.20.193.91:0/2698862424 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5115af46c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51101131c0 0x7f5110173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51162f56c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f511010cfb0 0x7f51100f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 -- 10.20.193.91:0/2698862424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51101131c0 msgr2=0x7f5110173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51101131c0 0x7f5110173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 -- 10.20.193.91:0/2698862424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f511010cfb0 msgr2=0x7f51100f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f511010cfb0 0x7f51100f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 -- 10.20.193.91:0/2698862424 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5104009590 con 0x7f51100f3070 2026-02-13T01:26:09.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f5116af66c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 0x7f51100f8340 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f510c006ea0 tx=0x7f510c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:09.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f510c003a30 con 0x7f51100f3070 2026-02-13T01:26:09.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51100f8d20 con 0x7f51100f3070 2026-02-13T01:26:09.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f510c0054f0 con 0x7f51100f3070 2026-02-13T01:26:09.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f510c00dcd0 con 0x7f51100f3070 2026-02-13T01:26:09.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.208+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51100f91b0 con 0x7f51100f3070 2026-02-13T01:26:09.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.209+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511010e280 con 0x7f51100f3070 2026-02-13T01:26:09.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.210+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f510c003b90 con 0x7f51100f3070 2026-02-13T01:26:09.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.211+0000 7f50f77fe6c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50ec0b56e0 0x7f50ec0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:09.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.211+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f510c0e4bc0 con 0x7f51100f3070 2026-02-13T01:26:09.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.211+0000 7f51162f56c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50ec0b56e0 0x7f50ec0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:09.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.211+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f510c0e50b0 con 0x7f51100f3070 2026-02-13T01:26:09.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.211+0000 7f51162f56c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50ec0b56e0 0x7f50ec0d5b90 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5100005dc0 tx=0x7f5100005d10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.325+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51100f91b0 con 0x7f51100f3070 2026-02-13T01:26:09.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.325+0000 7f50f77fe6c0 1 -- 10.20.193.91:0/2698862424 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f510c0a7440 con 0x7f51100f3070 2026-02-13T01:26:09.326 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:09.326 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50ec0b56e0 msgr2=0x7f50ec0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50ec0b56e0 0x7f50ec0d5b90 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5100005dc0 tx=0x7f5100005d10 comp rx=0 tx=0).stop 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 msgr2=0x7f51100f8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 0x7f51100f8340 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f510c006ea0 tx=0x7f510c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 shutdown_connections 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50ec0b56e0 0x7f50ec0d5b90 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f51100f3070 0x7f51100f8340 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f51101131c0 0x7f5110173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 --2- 10.20.193.91:0/2698862424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f511010cfb0 0x7f51100f2a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:09.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 >> 10.20.193.91:0/2698862424 conn(0x7f51100ea8b0 msgr2=0x7f511010b650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:09.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 shutdown_connections 2026-02-13T01:26:09.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:09.326+0000 7f51185846c0 1 -- 10.20.193.91:0/2698862424 wait complete. 2026-02-13T01:26:09.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:09 trial154 ceph-mon[27045]: pgmap v206: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T01:26:09.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:09 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2698862424' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:09.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:09 trial091 ceph-mon[25068]: pgmap v206: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T01:26:09.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:09 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2698862424' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:10.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:09 trial126 ceph-mon[26569]: pgmap v206: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T01:26:10.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:09 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2698862424' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:10.961 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:10 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:10.965 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:10 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:10.966 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:10 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:26:12.369 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:12.488 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:12.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/1877673722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf010fbf0 msgr2=0x7f7cf0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/1877673722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf010fbf0 0x7f7cf0114c30 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=1138837198584397145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cd80099a0 tx=0x7f7cd802ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:12.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/1877673722 shutdown_connections 2026-02-13T01:26:12.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/1877673722 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7cf0115410 0x7f7cf0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/1877673722 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf010fbf0 0x7f7cf0114c30 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=1138837198584397145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/1877673722 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf010f200 0x7f7cf010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/1877673722 >> 10.20.193.91:0/1877673722 conn(0x7f7cf00ecb00 msgr2=0x7f7cf010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/1877673722 shutdown_connections 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.602+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/1877673722 wait complete. 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 Processor -- start 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 -- start start 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7cf010f200 0x7f7cf00f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf0115410 0x7f7cf0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 0x7f7cf00fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00f59b0 con 0x7f7cf00f52c0 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00faad0 con 0x7f7cf0115410 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00fac90 con 0x7f7cf010f200 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 0x7f7cf00fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 0x7f7cf00fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:41886/0 (socket says 10.20.193.91:41886) 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 -- 10.20.193.91:0/933644304 learned_addr learned my addr 10.20.193.91:0/933644304 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf48926c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7cf010f200 0x7f7cf00f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 -- 10.20.193.91:0/933644304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7cf010f200 msgr2=0x7f7cf00f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7cf010f200 0x7f7cf00f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 -- 10.20.193.91:0/933644304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf0115410 msgr2=0x7f7cf0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7ce7fff6c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf0115410 0x7f7cf0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf0115410 0x7f7cf0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 -- 10.20.193.91:0/933644304 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd8009590 con 0x7f7cf00f52c0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7ce7fff6c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf0115410 0x7f7cf0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf50936c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 0x7f7cf00fa590 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cec006ea0 tx=0x7f7cec00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cec003a30 con 0x7f7cf00f52c0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7cec0054f0 con 0x7f7cf00f52c0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf00faf70 con 0x7f7cf00f52c0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cec00dcd0 con 0x7f7cf00f52c0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.603+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf00fb700 con 0x7f7cf00f52c0 2026-02-13T01:26:12.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.604+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf00fb450 con 0x7f7cf00f52c0 2026-02-13T01:26:12.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.605+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7cec003b90 con 0x7f7cf00f52c0 2026-02-13T01:26:12.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.606+0000 7f7ce5ffb6c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7ccc0b5760 0x7f7ccc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:12.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.606+0000 7f7cf48926c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7ccc0b5760 0x7f7ccc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:12.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.606+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7cec0e4d70 con 0x7f7cf00f52c0 2026-02-13T01:26:12.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.606+0000 7f7cf48926c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7ccc0b5760 0x7f7ccc0d5c10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ce0005980 tx=0x7f7ce0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:12.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.606+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7cec0a75b0 con 0x7f7cf00f52c0 2026-02-13T01:26:12.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: pgmap v207: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T01:26:12.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:12.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:12.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.726+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7cf00f5de0 con 0x7f7cf00f52c0 2026-02-13T01:26:12.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.726+0000 7f7ce5ffb6c0 1 -- 10.20.193.91:0/933644304 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7cec00de60 con 0x7f7cf00f52c0 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: pgmap v207: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:12.727 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:12.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:12.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:12.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:12.728 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:12.728 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:12.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7ccc0b5760 msgr2=0x7f7ccc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7ccc0b5760 0x7f7ccc0d5c10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ce0005980 tx=0x7f7ce0005910 comp rx=0 tx=0).stop 2026-02-13T01:26:12.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 msgr2=0x7f7cf00fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 0x7f7cf00fa590 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cec006ea0 tx=0x7f7cec00cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 shutdown_connections 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7ccc0b5760 0x7f7ccc0d5c10 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7cf00f52c0 0x7f7cf00fa590 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf0115410 0x7f7cf0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 --2- 10.20.193.91:0/933644304 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7cf010f200 0x7f7cf00f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 >> 10.20.193.91:0/933644304 conn(0x7f7cf00ecb00 msgr2=0x7f7cf0113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 shutdown_connections 2026-02-13T01:26:12.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:12.728+0000 7f7cf6b216c0 1 -- 10.20.193.91:0/933644304 wait complete. 2026-02-13T01:26:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: pgmap v207: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T01:26:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:26:12.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:26:12.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:26:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:13 trial154 ceph-mon[27045]: pgmap v208: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 10 op/s 2026-02-13T01:26:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:13 trial154 ceph-mon[27045]: pgmap v209: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:13.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:13 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/933644304' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:13.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:13 trial091 ceph-mon[25068]: pgmap v208: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 10 op/s 2026-02-13T01:26:13.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:13 trial091 ceph-mon[25068]: pgmap v209: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:13.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:13 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/933644304' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:13 trial126 ceph-mon[26569]: pgmap v208: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 10 op/s 2026-02-13T01:26:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:13 trial126 ceph-mon[26569]: pgmap v209: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:13 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/933644304' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:15.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:15 trial154 ceph-mon[27045]: pgmap v210: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:15 trial091 ceph-mon[25068]: pgmap v210: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:15.785 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:15.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:15 trial126 ceph-mon[26569]: pgmap v210: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:15.903 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:16.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- 10.20.193.91:0/3226976604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4010d970 msgr2=0x7f0b401129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:16.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- 10.20.193.91:0/3226976604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4010d970 0x7f0b401129b0 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=17277108205316779988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b280099a0 tx=0x7f0b2802ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:16.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- 10.20.193.91:0/3226976604 shutdown_connections 2026-02-13T01:26:16.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- 10.20.193.91:0/3226976604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b40113190 0x7f0b40173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- 10.20.193.91:0/3226976604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4010d970 0x7f0b401129b0 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=17277108205316779988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- 10.20.193.91:0/3226976604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b4010cf80 0x7f0b4010d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- 10.20.193.91:0/3226976604 >> 10.20.193.91:0/3226976604 conn(0x7f0b400ea880 msgr2=0x7f0b4010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- 10.20.193.91:0/3226976604 shutdown_connections 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- 10.20.193.91:0/3226976604 wait complete. 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 Processor -- start 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- start start 2026-02-13T01:26:16.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4010cf80 0x7f0b400f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b40113190 0x7f0b40173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 0x7f0b400fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400f59f0 con 0x7f0b400f5300 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400faac0 con 0x7f0b4010cf80 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b471156c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b400fac80 con 0x7f0b40113190 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 0x7f0b400fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:16.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 0x7f0b400fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:41898/0 (socket says 10.20.193.91:41898) 2026-02-13T01:26:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 -- 10.20.193.91:0/2726435808 learned_addr learned my addr 10.20.193.91:0/2726435808 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b44e866c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4010cf80 0x7f0b400f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:16.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b37fff6c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b40113190 0x7f0b40173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:16.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 -- 10.20.193.91:0/2726435808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b40113190 msgr2=0x7f0b40173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:16.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b40113190 0x7f0b40173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 -- 10.20.193.91:0/2726435808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4010cf80 msgr2=0x7f0b400f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:16.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4010cf80 0x7f0b400f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.021+0000 7f0b456876c0 1 -- 10.20.193.91:0/2726435808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b28009590 con 0x7f0b400f5300 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b456876c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 0x7f0b400fa580 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c006ea0 tx=0x7f0b3c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b3c003a30 con 0x7f0b400f5300 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b400faf60 con 0x7f0b400f5300 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0b3c0054f0 con 0x7f0b400f5300 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b3c00dcd0 con 0x7f0b400f5300 2026-02-13T01:26:16.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b400fb6f0 con 0x7f0b400f5300 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.022+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b400fb440 con 0x7f0b400f5300 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.023+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0b3c003b90 con 0x7f0b400f5300 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.024+0000 7f0b35ffb6c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b1c0b56e0 0x7f0b1c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.024+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f0b3c0e4d30 con 0x7f0b400f5300 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.024+0000 7f0b44e866c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b1c0b56e0 0x7f0b1c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.024+0000 7f0b44e866c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b1c0b56e0 0x7f0b1c0d5b90 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b30004750 tx=0x7f0b30009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:16.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.024+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b3c0a7570 con 0x7f0b400f5300 2026-02-13T01:26:16.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.140+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b4010e250 con 0x7f0b400f5300 2026-02-13T01:26:16.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.140+0000 7f0b35ffb6c0 1 -- 10.20.193.91:0/2726435808 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0b3c00de60 con 0x7f0b400f5300 2026-02-13T01:26:16.141 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:16.141 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b1c0b56e0 msgr2=0x7f0b1c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b1c0b56e0 0x7f0b1c0d5b90 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b30004750 tx=0x7f0b30009390 comp rx=0 tx=0).stop 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 msgr2=0x7f0b400fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 0x7f0b400fa580 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c006ea0 tx=0x7f0b3c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 shutdown_connections 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b1c0b56e0 0x7f0b1c0d5b90 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b400f5300 0x7f0b400fa580 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b40113190 0x7f0b40173a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 --2- 10.20.193.91:0/2726435808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4010cf80 0x7f0b400f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:16.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 >> 10.20.193.91:0/2726435808 conn(0x7f0b400ea880 msgr2=0x7f0b401118d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:16.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 shutdown_connections 2026-02-13T01:26:16.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:16.142+0000 7f0b471156c0 1 -- 10.20.193.91:0/2726435808 wait complete. 2026-02-13T01:26:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:16 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2726435808' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:16.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:16 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2726435808' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:16.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:16 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2726435808' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:17.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:17 trial154 ceph-mon[27045]: pgmap v211: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:17 trial091 ceph-mon[25068]: pgmap v211: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:17.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:17 trial126 ceph-mon[26569]: pgmap v211: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:19.186 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:19.305 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/813721738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 msgr2=0x7f1f58175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/813721738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f58175db0 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=18185722677953207776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f5400aa70 tx=0x7f1f5402fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/813721738 shutdown_connections 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/813721738 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f58175db0 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=18185722677953207776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/813721738 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810fbf0 0x7f1f58114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/813721738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 0x7f1f5810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/813721738 >> 10.20.193.91:0/813721738 conn(0x7f1f580ecb00 msgr2=0x7f1f5810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/813721738 shutdown_connections 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/813721738 wait complete. 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 Processor -- start 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- start start 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58123560 con 0x7f1f58115410 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581236d0 con 0x7f1f5810f200 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.426+0000 7f1f5fbd56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58123890 con 0x7f1f58122b50 2026-02-13T01:26:19.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:38634/0 (socket says 10.20.193.91:38634) 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 -- 10.20.193.91:0/2615945427 learned_addr learned my addr 10.20.193.91:0/2615945427 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d9466c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5e1476c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 -- 10.20.193.91:0/2615945427 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f58122b50 msgr2=0x7f1f58122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 -- 10.20.193.91:0/2615945427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 msgr2=0x7f1f5811d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 -- 10.20.193.91:0/2615945427 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5400a660 con 0x7f1f58115410 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5d1456c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4c00b6c0 tx=0x7f1f4c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:19.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f4c004250 con 0x7f1f58115410 2026-02-13T01:26:19.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1f4c009070 con 0x7f1f58115410 2026-02-13T01:26:19.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f58163d40 con 0x7f1f58115410 2026-02-13T01:26:19.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f4c00ccb0 con 0x7f1f58115410 2026-02-13T01:26:19.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581641d0 con 0x7f1f58115410 2026-02-13T01:26:19.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.427+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f581104d0 con 0x7f1f58115410 2026-02-13T01:26:19.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.429+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f1f4c0028c0 con 0x7f1f58115410 2026-02-13T01:26:19.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.430+0000 7f1f46ffd6c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f340b5760 0x7f1f340d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:19.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.430+0000 7f1f5d9466c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f340b5760 0x7f1f340d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:19.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.430+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f1f4c0e3dc0 con 0x7f1f58115410 2026-02-13T01:26:19.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.430+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1f4c0e4240 con 0x7f1f58115410 2026-02-13T01:26:19.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.430+0000 7f1f5d9466c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f340b5760 0x7f1f340d5c10 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f48005980 tx=0x7f1f48005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:19.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:19 trial091 ceph-mon[25068]: pgmap v212: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:19.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.545+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f5810f5d0 con 0x7f1f58115410 2026-02-13T01:26:19.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.545+0000 7f1f46ffd6c0 1 -- 10.20.193.91:0/2615945427 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1f4c0a6600 con 0x7f1f58115410 2026-02-13T01:26:19.546 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:19.546 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f340b5760 msgr2=0x7f1f340d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f340b5760 0x7f1f340d5c10 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f48005980 tx=0x7f1f48005910 comp rx=0 tx=0).stop 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 msgr2=0x7f1f5811d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4c00b6c0 tx=0x7f1f4c00bb90 comp rx=0 tx=0).stop 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 shutdown_connections 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f340b5760 0x7f1f340d5c10 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 --2- 10.20.193.91:0/2615945427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:19.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 >> 10.20.193.91:0/2615945427 conn(0x7f1f580ecb00 msgr2=0x7f1f5810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:19.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 shutdown_connections 2026-02-13T01:26:19.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:19.546+0000 7f1f5fbd56c0 1 -- 10.20.193.91:0/2615945427 wait complete. 2026-02-13T01:26:19.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:19 trial154 ceph-mon[27045]: pgmap v212: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:19.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:19 trial126 ceph-mon[26569]: pgmap v212: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:20.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:20 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2615945427' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:20 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2615945427' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:20.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:20 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2615945427' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:21.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:21 trial154 ceph-mon[27045]: pgmap v213: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:21.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:21 trial091 ceph-mon[25068]: pgmap v213: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:21.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:21 trial126 ceph-mon[26569]: pgmap v213: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:26:22.587 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:22.708 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:22.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/2919533458 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce410f200 msgr2=0x7f2ce410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/2919533458 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce410f200 0x7f2ce410f5d0 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=14682575418467060033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd40099a0 tx=0x7f2cd402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:22.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/2919533458 shutdown_connections 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/2919533458 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ce4115410 0x7f2ce4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/2919533458 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2ce410fbf0 0x7f2ce4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/2919533458 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce410f200 0x7f2ce410f5d0 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=14682575418467060033 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/2919533458 >> 10.20.193.91:0/2919533458 conn(0x7f2ce40ecb00 msgr2=0x7f2ce410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/2919533458 shutdown_connections 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.824+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/2919533458 wait complete. 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 Processor -- start 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 -- start start 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ce410f200 0x7f2ce411d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2ce4115410 0x7f2ce411d800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 0x7f2ce4123060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce41235d0 con 0x7f2ce4122bc0 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4123740 con 0x7f2ce410f200 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce4123900 con 0x7f2ce4115410 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 0x7f2ce4123060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 0x7f2ce4123060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:38658/0 (socket says 10.20.193.91:38658) 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 -- 10.20.193.91:0/4132732518 learned_addr learned my addr 10.20.193.91:0/4132732518 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce97fd6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ce410f200 0x7f2ce411d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce8ffc6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2ce4115410 0x7f2ce411d800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 -- 10.20.193.91:0/4132732518 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2ce4115410 msgr2=0x7f2ce411d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2ce4115410 0x7f2ce411d800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 -- 10.20.193.91:0/4132732518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ce410f200 msgr2=0x7f2ce411d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ce410f200 0x7f2ce411d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 -- 10.20.193.91:0/4132732518 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd4009590 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ce9ffe6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 0x7f2ce4123060 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce0006ea0 tx=0x7f2ce000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ce0003a30 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2ce00054f0 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ce000dcd0 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce4163db0 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.825+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce4164240 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.826+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce41104d0 con 0x7f2ce4122bc0 2026-02-13T01:26:22.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.827+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2ce0005030 con 0x7f2ce4122bc0 2026-02-13T01:26:22.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.828+0000 7f2cd27fc6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2cc00b5760 0x7f2cc00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:22.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.828+0000 7f2ce97fd6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2cc00b5760 0x7f2cc00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:22.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.828+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f2ce00e4e60 con 0x7f2ce4122bc0 2026-02-13T01:26:22.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.828+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ce00aa850 con 0x7f2ce4122bc0 2026-02-13T01:26:22.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.828+0000 7f2ce97fd6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2cc00b5760 0x7f2cc00d5c10 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd40092e0 tx=0x7f2cd4005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:22.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.942+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2ce410f5d0 con 0x7f2ce4122bc0 2026-02-13T01:26:22.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.942+0000 7f2cd27fc6c0 1 -- 10.20.193.91:0/4132732518 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2ce00aaa30 con 0x7f2ce4122bc0 2026-02-13T01:26:22.943 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:22.943 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:22.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2cc00b5760 msgr2=0x7f2cc00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2cc00b5760 0x7f2cc00d5c10 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cd40092e0 tx=0x7f2cd4005c00 comp rx=0 tx=0).stop 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 msgr2=0x7f2ce4123060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 0x7f2ce4123060 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce0006ea0 tx=0x7f2ce000cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 shutdown_connections 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2cc00b5760 0x7f2cc00d5c10 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2ce4122bc0 0x7f2ce4123060 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2ce4115410 0x7f2ce411d800 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 --2- 10.20.193.91:0/4132732518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ce410f200 0x7f2ce411d2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 >> 10.20.193.91:0/4132732518 conn(0x7f2ce40ecb00 msgr2=0x7f2ce410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 shutdown_connections 2026-02-13T01:26:22.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:22.943+0000 7f2ceba8c6c0 1 -- 10.20.193.91:0/4132732518 wait complete. 2026-02-13T01:26:23.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:23 trial154 ceph-mon[27045]: pgmap v214: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:23.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4132732518' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:23.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:23 trial091 ceph-mon[25068]: pgmap v214: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:23.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4132732518' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:23 trial126 ceph-mon[26569]: pgmap v214: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:26:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4132732518' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:24.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:24 trial154 ceph-mon[27045]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T01:26:24.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:24 trial091 ceph-mon[25068]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T01:26:24.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:24 trial126 ceph-mon[26569]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T01:26:25.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:25 trial154 ceph-mon[27045]: pgmap v215: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T01:26:25.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:25 trial091 ceph-mon[25068]: pgmap v215: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T01:26:25.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:25 trial126 ceph-mon[26569]: pgmap v215: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T01:26:25.984 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:26.103 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:26.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 -- 10.20.193.91:0/427708396 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc1149f0 msgr2=0x7f63fc11d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 --2- 10.20.193.91:0/427708396 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc1149f0 0x7f63fc11d6d0 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=16745712385752544941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63e40099a0 tx=0x7f63e402ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:26.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 -- 10.20.193.91:0/427708396 shutdown_connections 2026-02-13T01:26:26.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 --2- 10.20.193.91:0/427708396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63fc11deb0 0x7f63fc17e850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 --2- 10.20.193.91:0/427708396 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc1149f0 0x7f63fc11d6d0 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=16745712385752544941 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 --2- 10.20.193.91:0/427708396 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc114000 0x7f63fc1143d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 -- 10.20.193.91:0/427708396 >> 10.20.193.91:0/427708396 conn(0x7f63fc05c880 msgr2=0x7f63fc058b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 -- 10.20.193.91:0/427708396 shutdown_connections 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 -- 10.20.193.91:0/427708396 wait complete. 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 Processor -- start 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.218+0000 7f64031c36c0 1 -- start start 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 0x7f63fc126780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc11deb0 0x7f63fc126cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63fc12c080 0x7f63fc12c520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc12ca90 con 0x7f63fc114000 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc12cc00 con 0x7f63fc12c080 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc12cdc0 con 0x7f63fc11deb0 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 0x7f63fc126780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 0x7f63fc126780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:38668/0 (socket says 10.20.193.91:38668) 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 -- 10.20.193.91:0/114766514 learned_addr learned my addr 10.20.193.91:0/114766514 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f63f3fff6c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc11deb0 0x7f63fc126cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 -- 10.20.193.91:0/114766514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc11deb0 msgr2=0x7f63fc126cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc11deb0 0x7f63fc126cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 -- 10.20.193.91:0/114766514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63fc12c080 msgr2=0x7f63fc12c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63fc12c080 0x7f63fc12c520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 -- 10.20.193.91:0/114766514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e4009590 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f63f3fff6c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc11deb0 0x7f63fc126cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f6400f346c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 0x7f63fc126780 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63ec005dc0 tx=0x7f63ec00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63ec004250 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f63ec009070 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc16d270 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63ec00cd70 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc16d700 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.219+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc0565c0 con 0x7f63fc114000 2026-02-13T01:26:26.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.221+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f63ec0028c0 con 0x7f63fc114000 2026-02-13T01:26:26.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.221+0000 7f63f1ffb6c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63d80b56d0 0x7f63d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:26.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.222+0000 7f63f3fff6c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63d80b56d0 0x7f63d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:26.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.222+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f63ec0e3c30 con 0x7f63fc114000 2026-02-13T01:26:26.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.222+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f63ec0aa030 con 0x7f63fc114000 2026-02-13T01:26:26.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.222+0000 7f63f3fff6c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63d80b56d0 0x7f63d80d5b80 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63fc12d110 tx=0x7f63e40023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:26.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.337+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f63fc1143d0 con 0x7f63fc114000 2026-02-13T01:26:26.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.337+0000 7f63f1ffb6c0 1 -- 10.20.193.91:0/114766514 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f63ec0a9780 con 0x7f63fc114000 2026-02-13T01:26:26.338 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:26.338 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63d80b56d0 msgr2=0x7f63d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63d80b56d0 0x7f63d80d5b80 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63fc12d110 tx=0x7f63e40023a0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 msgr2=0x7f63fc126780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 0x7f63fc126780 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63ec005dc0 tx=0x7f63ec00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 shutdown_connections 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63d80b56d0 0x7f63d80d5b80 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63fc12c080 0x7f63fc12c520 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f63fc11deb0 0x7f63fc126cc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 --2- 10.20.193.91:0/114766514 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f63fc114000 0x7f63fc126780 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:26.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 >> 10.20.193.91:0/114766514 conn(0x7f63fc05c880 msgr2=0x7f63fc11c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:26.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 shutdown_connections 2026-02-13T01:26:26.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:26.339+0000 7f64031c36c0 1 -- 10.20.193.91:0/114766514 wait complete. 2026-02-13T01:26:26.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/114766514' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:26.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/114766514' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:26.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/114766514' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:27.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:27 trial154 ceph-mon[27045]: pgmap v216: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T01:26:27.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:27 trial091 ceph-mon[25068]: pgmap v216: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T01:26:27.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:27 trial126 ceph-mon[26569]: pgmap v216: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T01:26:29.380 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:29.501 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.618+0000 7f14bd8036c0 1 -- 10.20.193.91:0/652565064 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b811de10 msgr2=0x7f14b817e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.618+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/652565064 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b811de10 0x7f14b817e7b0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=13390236813800717869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14a800aa70 tx=0x7f14a802fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- 10.20.193.91:0/652565064 shutdown_connections 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/652565064 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b811de10 0x7f14b817e7b0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=13390236813800717869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/652565064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14b81185f0 0x7f14b811d630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/652565064 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14b8117c00 0x7f14b8117fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- 10.20.193.91:0/652565064 >> 10.20.193.91:0/652565064 conn(0x7f14b80f54a0 msgr2=0x7f14b81158b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- 10.20.193.91:0/652565064 shutdown_connections 2026-02-13T01:26:29.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- 10.20.193.91:0/652565064 wait complete. 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 Processor -- start 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- start start 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 0x7f14b8125bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14b811de10 0x7f14b8126130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14b812b4f0 0x7f14b812b990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f14b812bf00 con 0x7f14b8117c00 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f14b812c070 con 0x7f14b812b4f0 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14b812c230 con 0x7f14b811de10 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 0x7f14b8125bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 0x7f14b8125bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:55918/0 (socket says 10.20.193.91:55918) 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 -- 10.20.193.91:0/1987993986 learned_addr learned my addr 10.20.193.91:0/1987993986 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:29.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 -- 10.20.193.91:0/1987993986 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14b811de10 msgr2=0x7f14b8126130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14b811de10 0x7f14b8126130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 -- 10.20.193.91:0/1987993986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14b812b4f0 msgr2=0x7f14b812b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14b812b4f0 0x7f14b812b990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 -- 10.20.193.91:0/1987993986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a800a660 con 0x7f14b8117c00 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14b6ffd6c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 0x7f14b8125bf0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14ac009490 tx=0x7f14ac00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14ac004a80 con 0x7f14b8117c00 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b816c6e0 con 0x7f14b8117c00 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.619+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f14ac009030 con 0x7f14b8117c00 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.620+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14ac00cdd0 con 0x7f14b8117c00 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.620+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b816cb70 con 0x7f14b8117c00 2026-02-13T01:26:29.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.620+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b8118ed0 con 0x7f14b8117c00 2026-02-13T01:26:29.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.621+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f14ac005000 con 0x7f14b8117c00 2026-02-13T01:26:29.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.622+0000 7f1497fff6c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f148c0b5650 0x7f148c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:29.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.622+0000 7f14b67fc6c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f148c0b5650 0x7f148c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:29.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.622+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f14ac0e3d30 con 0x7f14b8117c00 2026-02-13T01:26:29.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.622+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f14ac0aa130 con 0x7f14b8117c00 2026-02-13T01:26:29.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.622+0000 7f14b67fc6c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f148c0b5650 0x7f148c0d5b00 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14b812c580 tx=0x7f14a00096a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:29.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:29 trial154 ceph-mon[27045]: pgmap v217: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T01:26:29.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:29 trial091 ceph-mon[25068]: pgmap v217: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T01:26:29.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.739+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f14b81185f0 con 0x7f14b8117c00 2026-02-13T01:26:29.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.739+0000 7f1497fff6c0 1 -- 10.20.193.91:0/1987993986 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f14ac0a9880 con 0x7f14b8117c00 2026-02-13T01:26:29.740 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:29.740 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:29.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f148c0b5650 msgr2=0x7f148c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:29.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f148c0b5650 0x7f148c0d5b00 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14b812c580 tx=0x7f14a00096a0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 msgr2=0x7f14b8125bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:29.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 0x7f14b8125bf0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14ac009490 tx=0x7f14ac00bc50 comp rx=0 tx=0).stop 2026-02-13T01:26:29.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 shutdown_connections 2026-02-13T01:26:29.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f148c0b5650 0x7f148c0d5b00 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14b812b4f0 0x7f14b812b990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14b811de10 0x7f14b8126130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 --2- 10.20.193.91:0/1987993986 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14b8117c00 0x7f14b8125bf0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:29.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 >> 10.20.193.91:0/1987993986 conn(0x7f14b80f54a0 msgr2=0x7f14b8115880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:29.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 shutdown_connections 2026-02-13T01:26:29.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:29.740+0000 7f14bd8036c0 1 -- 10.20.193.91:0/1987993986 wait complete. 2026-02-13T01:26:29.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:29 trial126 ceph-mon[26569]: pgmap v217: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T01:26:30.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:30 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1987993986' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:30.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:30 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1987993986' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:30.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:30 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1987993986' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:31.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:31 trial154 ceph-mon[27045]: pgmap v218: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T01:26:31.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:31 trial091 ceph-mon[25068]: pgmap v218: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T01:26:31.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:31 trial126 ceph-mon[26569]: pgmap v218: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T01:26:32.783 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:32.903 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:33.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 -- 10.20.193.91:0/1978261592 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 msgr2=0x7feb24175bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/1978261592 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24175bc0 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=17679920642086879766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb2000aa40 tx=0x7feb2002fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 -- 10.20.193.91:0/1978261592 shutdown_connections 2026-02-13T01:26:33.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/1978261592 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24175bc0 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=17679920642086879766 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/1978261592 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb2410c3c0 0x7feb241552a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/1978261592 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410bab0 0x7feb2410be80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 -- 10.20.193.91:0/1978261592 >> 10.20.193.91:0/1978261592 conn(0x7feb240e9770 msgr2=0x7feb24109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 -- 10.20.193.91:0/1978261592 shutdown_connections 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.020+0000 7feb2c2956c0 1 -- 10.20.193.91:0/1978261592 wait complete. 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 Processor -- start 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 -- start start 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb2410bab0 0x7feb24160560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410c3c0 0x7feb24160aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24165e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7feb241664b0 con 0x7feb241557e0 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feb24166620 con 0x7feb2410c3c0 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb241667e0 con 0x7feb2410bab0 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24165e60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:55948/0 (socket says 10.20.193.91:55948) 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 -- 10.20.193.91:0/210472134 learned_addr learned my addr 10.20.193.91:0/210472134 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a0066c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb2410bab0 0x7feb24160560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb298056c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410c3c0 0x7feb24160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 -- 10.20.193.91:0/210472134 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb2410bab0 msgr2=0x7feb24160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb2410bab0 0x7feb24160560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 -- 10.20.193.91:0/210472134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410c3c0 msgr2=0x7feb24160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410c3c0 0x7feb24160aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 -- 10.20.193.91:0/210472134 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2000a660 con 0x7feb241557e0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb298056c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410c3c0 0x7feb24160aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2a8076c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24165e60 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb200054b0 tx=0x7feb200054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb20003a30 con 0x7feb241557e0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb24166a60 con 0x7feb241557e0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7feb20003b90 con 0x7feb241557e0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb200382f0 con 0x7feb241557e0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.021+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb24152420 con 0x7feb241557e0 2026-02-13T01:26:33.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.022+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2405fb10 con 0x7feb241557e0 2026-02-13T01:26:33.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.023+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7feb20008260 con 0x7feb241557e0 2026-02-13T01:26:33.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.024+0000 7feb0b7fe6c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7feb000b5650 0x7feb000d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:33.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.024+0000 7feb2a0066c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7feb000b5650 0x7feb000d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:33.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.024+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7feb20108fa0 con 0x7feb241557e0 2026-02-13T01:26:33.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.024+0000 7feb2a0066c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7feb000b5650 0x7feb000d5b00 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb14006b60 tx=0x7feb14006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:33.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.024+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feb200cb980 con 0x7feb241557e0 2026-02-13T01:26:33.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.141+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb241616b0 con 0x7feb241557e0 2026-02-13T01:26:33.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.141+0000 7feb0b7fe6c0 1 -- 10.20.193.91:0/210472134 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feb200ceb30 con 0x7feb241557e0 2026-02-13T01:26:33.142 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:33.142 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:33.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7feb000b5650 msgr2=0x7feb000d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7feb000b5650 0x7feb000d5b00 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb14006b60 tx=0x7feb14006af0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 msgr2=0x7feb24165e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24165e60 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb200054b0 tx=0x7feb200054e0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 shutdown_connections 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7feb000b5650 0x7feb000d5b00 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7feb241557e0 0x7feb24165e60 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feb2410c3c0 0x7feb24160aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 --2- 10.20.193.91:0/210472134 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7feb2410bab0 0x7feb24160560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 >> 10.20.193.91:0/210472134 conn(0x7feb240e9770 msgr2=0x7feb24109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 shutdown_connections 2026-02-13T01:26:33.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:33.143+0000 7feb2c2956c0 1 -- 10.20.193.91:0/210472134 wait complete. 2026-02-13T01:26:33.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:33 trial154 ceph-mon[27045]: pgmap v219: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T01:26:33.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:33 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/210472134' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:33.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:33 trial091 ceph-mon[25068]: pgmap v219: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T01:26:33.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:33 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/210472134' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:33.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:33 trial126 ceph-mon[26569]: pgmap v219: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T01:26:33.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:33 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/210472134' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:35.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:35 trial154 ceph-mon[27045]: pgmap v220: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T01:26:35.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:35 trial091 ceph-mon[25068]: pgmap v220: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T01:26:35.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:35 trial126 ceph-mon[26569]: pgmap v220: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T01:26:36.184 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:36.303 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:36.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3893144702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a410f200 msgr2=0x7fb3a410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3893144702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a410f200 0x7fb3a410f5d0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=3509933139725501235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3980099a0 tx=0x7fb39802ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:36.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3893144702 shutdown_connections 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3893144702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb3a4115410 0x7fb3a4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3893144702 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3a410fbf0 0x7fb3a4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3893144702 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a410f200 0x7fb3a410f5d0 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=3509933139725501235 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3893144702 >> 10.20.193.91:0/3893144702 conn(0x7fb3a40ecb00 msgr2=0x7fb3a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3893144702 shutdown_connections 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3893144702 wait complete. 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 Processor -- start 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- start start 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3a410f200 0x7fb3a411d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb3a4115410 0x7fb3a411d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:36.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 0x7fb3a4123130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a41236a0 con 0x7fb3a4122c90 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a4123810 con 0x7fb3a4115410 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.417+0000 7fb3a99916c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a41239d0 con 0x7fb3a410f200 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 0x7fb3a4123130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 0x7fb3a4123130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:55966/0 (socket says 10.20.193.91:55966) 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a27fc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb3a4115410 0x7fb3a411d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 -- 10.20.193.91:0/3376954085 learned_addr learned my addr 10.20.193.91:0/3376954085 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a2ffd6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3a410f200 0x7fb3a411d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 -- 10.20.193.91:0/3376954085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3a410f200 msgr2=0x7fb3a411d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3a410f200 0x7fb3a411d390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 -- 10.20.193.91:0/3376954085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb3a4115410 msgr2=0x7fb3a411d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb3a4115410 0x7fb3a411d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 -- 10.20.193.91:0/3376954085 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb398009590 con 0x7fb3a4122c90 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a37fe6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 0x7fb3a4123130 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb394006ea0 tx=0x7fb39400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb394003a30 con 0x7fb3a4122c90 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb3940054f0 con 0x7fb3a4122c90 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb39400dcd0 con 0x7fb3a4122c90 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a4163e80 con 0x7fb3a4122c90 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a4164360 con 0x7fb3a4122c90 2026-02-13T01:26:36.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.418+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a41104d0 con 0x7fb3a4122c90 2026-02-13T01:26:36.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.420+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb394005030 con 0x7fb3a4122c90 2026-02-13T01:26:36.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.421+0000 7fb3a898b6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3780b56d0 0x7fb3780d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:36.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.421+0000 7fb3a2ffd6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3780b56d0 0x7fb3780d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:36.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.421+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fb3940e4c60 con 0x7fb3a4122c90 2026-02-13T01:26:36.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.421+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3940e50e0 con 0x7fb3a4122c90 2026-02-13T01:26:36.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.421+0000 7fb3a2ffd6c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3780b56d0 0x7fb3780d5b80 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3980092e0 tx=0x7fb398005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:36.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.538+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb3a410f5d0 con 0x7fb3a4122c90 2026-02-13T01:26:36.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.538+0000 7fb3a898b6c0 1 -- 10.20.193.91:0/3376954085 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb3940a7600 con 0x7fb3a4122c90 2026-02-13T01:26:36.539 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:36.539 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:36.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3780b56d0 msgr2=0x7fb3780d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3780b56d0 0x7fb3780d5b80 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3980092e0 tx=0x7fb398005c00 comp rx=0 tx=0).stop 2026-02-13T01:26:36.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 msgr2=0x7fb3a4123130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:36.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 0x7fb3a4123130 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb394006ea0 tx=0x7fb39400cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 shutdown_connections 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3780b56d0 0x7fb3780d5b80 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb3a4122c90 0x7fb3a4123130 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb3a4115410 0x7fb3a411d8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 --2- 10.20.193.91:0/3376954085 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb3a410f200 0x7fb3a411d390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 >> 10.20.193.91:0/3376954085 conn(0x7fb3a40ecb00 msgr2=0x7fb3a410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 shutdown_connections 2026-02-13T01:26:36.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:36.539+0000 7fb3a99916c0 1 -- 10.20.193.91:0/3376954085 wait complete. 2026-02-13T01:26:37.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:37 trial154 ceph-mon[27045]: pgmap v221: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:26:37.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:37 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3376954085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:37 trial091 ceph-mon[25068]: pgmap v221: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:26:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:37 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3376954085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:37.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:37 trial126 ceph-mon[26569]: pgmap v221: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T01:26:37.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:37 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3376954085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:39.582 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:39.701 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:39.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:39 trial154 ceph-mon[27045]: pgmap v222: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:39.724 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:39 trial091 ceph-mon[25068]: pgmap v222: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:39.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 -- 10.20.193.91:0/2801819809 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110115440 msgr2=0x7f0110175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 --2- 10.20.193.91:0/2801819809 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110115440 0x7f0110175de0 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=9749289063068096558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f010c00aa70 tx=0x7f010c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 -- 10.20.193.91:0/2801819809 shutdown_connections 2026-02-13T01:26:39.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 --2- 10.20.193.91:0/2801819809 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110115440 0x7f0110175de0 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=9749289063068096558 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 --2- 10.20.193.91:0/2801819809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f011010fc20 0x7f0110114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 --2- 10.20.193.91:0/2801819809 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 0x7f011010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 -- 10.20.193.91:0/2801819809 >> 10.20.193.91:0/2801819809 conn(0x7f01100ecb30 msgr2=0x7f011010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 -- 10.20.193.91:0/2801819809 shutdown_connections 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.821+0000 7f01184c86c0 1 -- 10.20.193.91:0/2801819809 wait complete. 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 Processor -- start 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 -- start start 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 0x7f011011d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0110115440 0x7f011011d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 0x7f0110122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0110123510 con 0x7f0110122b00 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0110123680 con 0x7f0110115440 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0110123840 con 0x7f011010f230 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 0x7f0110122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 0x7f0110122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36510/0 (socket says 10.20.193.91:36510) 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 -- 10.20.193.91:0/429953958 learned_addr learned my addr 10.20.193.91:0/429953958 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01162396c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 0x7f011011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0115a386c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0110115440 0x7f011011d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 -- 10.20.193.91:0/429953958 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 msgr2=0x7f011011d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 0x7f011011d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 -- 10.20.193.91:0/429953958 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0110115440 msgr2=0x7f011011d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0110115440 0x7f011011d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 -- 10.20.193.91:0/429953958 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c00a660 con 0x7f0110122b00 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01162396c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 0x7f011011d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f0116a3a6c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 0x7f0110122fa0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f010c0054b0 tx=0x7f010c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f010c003a30 con 0x7f0110122b00 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0110163c90 con 0x7f0110122b00 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f010c003b90 con 0x7f0110122b00 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f010c0382f0 con 0x7f0110122b00 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.822+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01101640c0 con 0x7f0110122b00 2026-02-13T01:26:39.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.823+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0110110500 con 0x7f0110122b00 2026-02-13T01:26:39.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.824+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f010c008260 con 0x7f0110122b00 2026-02-13T01:26:39.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.825+0000 7f00f77fe6c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00ec0b5650 0x7f00ec0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:39.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.825+0000 7f01162396c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00ec0b5650 0x7f00ec0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:39.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.825+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f010c108ff0 con 0x7f0110122b00 2026-02-13T01:26:39.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.825+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f010c0cf410 con 0x7f0110122b00 2026-02-13T01:26:39.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.825+0000 7f01162396c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00ec0b5650 0x7f00ec0d5b00 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0100004750 tx=0x7f0100009630 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:39.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:39 trial126 ceph-mon[26569]: pgmap v222: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:39.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.939+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f011010f600 con 0x7f0110122b00 2026-02-13T01:26:39.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.939+0000 7f00f77fe6c0 1 -- 10.20.193.91:0/429953958 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f010c095990 con 0x7f0110122b00 2026-02-13T01:26:39.938 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:39.939 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00ec0b5650 msgr2=0x7f00ec0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00ec0b5650 0x7f00ec0d5b00 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0100004750 tx=0x7f0100009630 comp rx=0 tx=0).stop 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 msgr2=0x7f0110122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 0x7f0110122fa0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f010c0054b0 tx=0x7f010c0054e0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 shutdown_connections 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00ec0b5650 0x7f00ec0d5b00 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0110122b00 0x7f0110122fa0 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0110115440 0x7f011011d740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 --2- 10.20.193.91:0/429953958 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f011010f230 0x7f011011d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:39.940 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 >> 10.20.193.91:0/429953958 conn(0x7f01100ecb30 msgr2=0x7f011010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:39.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 shutdown_connections 2026-02-13T01:26:39.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:39.940+0000 7f01184c86c0 1 -- 10.20.193.91:0/429953958 wait complete. 2026-02-13T01:26:40.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:40 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/429953958' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:40.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:40 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/429953958' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:40.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:40 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/429953958' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:41.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:41 trial154 ceph-mon[27045]: pgmap v223: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:41.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:41 trial091 ceph-mon[25068]: pgmap v223: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:41.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:41 trial126 ceph-mon[26569]: pgmap v223: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:42.980 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:43.101 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:43.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 -- 10.20.193.91:0/37863841 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f829010f200 msgr2=0x7f829010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 --2- 10.20.193.91:0/37863841 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f829010f200 0x7f829010f5d0 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=6833491866300246492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f82800099a0 tx=0x7f828002ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:43.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 -- 10.20.193.91:0/37863841 shutdown_connections 2026-02-13T01:26:43.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 --2- 10.20.193.91:0/37863841 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8290115410 0x7f8290175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 --2- 10.20.193.91:0/37863841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f829010fbf0 0x7f8290114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 --2- 10.20.193.91:0/37863841 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f829010f200 0x7f829010f5d0 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=6833491866300246492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 -- 10.20.193.91:0/37863841 >> 10.20.193.91:0/37863841 conn(0x7f82900ecb00 msgr2=0x7f829010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 -- 10.20.193.91:0/37863841 shutdown_connections 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 -- 10.20.193.91:0/37863841 wait complete. 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 Processor -- start 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.220+0000 7f8297f246c0 1 -- start start 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829010f200 0x7f829011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8290115410 0x7f829011d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 0x7f8290123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8290123600 con 0x7f8290122bf0 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8290123770 con 0x7f8290115410 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8290123930 con 0x7f829010f200 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 0x7f8290123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 0x7f8290123090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36534/0 (socket says 10.20.193.91:36534) 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 -- 10.20.193.91:0/48836340 learned_addr learned my addr 10.20.193.91:0/48836340 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 -- 10.20.193.91:0/48836340 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829010f200 msgr2=0x7f829011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829010f200 0x7f829011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 -- 10.20.193.91:0/48836340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8290115410 msgr2=0x7f829011d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8290115410 0x7f829011d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 -- 10.20.193.91:0/48836340 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8280009590 con 0x7f8290122bf0 2026-02-13T01:26:43.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f82964966c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 0x7f8290123090 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c006ea0 tx=0x7f828c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828c003a30 con 0x7f8290122bf0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f828c0054f0 con 0x7f8290122bf0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f828c00dcd0 con 0x7f8290122bf0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8290163de0 con 0x7f8290122bf0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8290164270 con 0x7f8290122bf0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.221+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82901104d0 con 0x7f8290122bf0 2026-02-13T01:26:43.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.222+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f828c005030 con 0x7f8290122bf0 2026-02-13T01:26:43.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.223+0000 7f827effd6c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f826c0b56d0 0x7f826c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:43.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.223+0000 7f8295c956c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f826c0b56d0 0x7f826c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:43.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.223+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f828c0e4cd0 con 0x7f8290122bf0 2026-02-13T01:26:43.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.224+0000 7f8295c956c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f826c0b56d0 0x7f826c0d5b80 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280005b40 tx=0x7f8280005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:43.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.224+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f828c0a7670 con 0x7f8290122bf0 2026-02-13T01:26:43.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.339+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f829010f5d0 con 0x7f8290122bf0 2026-02-13T01:26:43.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.340+0000 7f827effd6c0 1 -- 10.20.193.91:0/48836340 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f828c00de60 con 0x7f8290122bf0 2026-02-13T01:26:43.340 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:43.340 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:43.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f826c0b56d0 msgr2=0x7f826c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f826c0b56d0 0x7f826c0d5b80 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8280005b40 tx=0x7f8280005c60 comp rx=0 tx=0).stop 2026-02-13T01:26:43.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 msgr2=0x7f8290123090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:43.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 0x7f8290123090 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f828c006ea0 tx=0x7f828c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 shutdown_connections 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f826c0b56d0 0x7f826c0d5b80 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8290122bf0 0x7f8290123090 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8290115410 0x7f829011d830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 --2- 10.20.193.91:0/48836340 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f829010f200 0x7f829011d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 >> 10.20.193.91:0/48836340 conn(0x7f82900ecb00 msgr2=0x7f829010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 shutdown_connections 2026-02-13T01:26:43.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:43.341+0000 7f8297f246c0 1 -- 10.20.193.91:0/48836340 wait complete. 2026-02-13T01:26:43.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:43 trial154 ceph-mon[27045]: pgmap v224: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:43.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:43 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/48836340' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:43.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:43 trial091 ceph-mon[25068]: pgmap v224: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:43.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:43 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/48836340' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:43.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:43 trial126 ceph-mon[26569]: pgmap v224: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:43.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:43 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/48836340' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:45.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:45 trial154 ceph-mon[27045]: pgmap v225: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:26:45.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:45 trial091 ceph-mon[25068]: pgmap v225: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:26:45.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:45 trial126 ceph-mon[26569]: pgmap v225: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:26:46.381 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:46.503 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/733764906 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 msgr2=0x7fe1a8175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/733764906 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a8175de0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=11253524604075553031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe19c00aa70 tx=0x7fe19c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/733764906 shutdown_connections 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/733764906 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a8175de0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=11253524604075553031 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/733764906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a810fc20 0x7fe1a8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/733764906 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a810f230 0x7fe1a810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/733764906 >> 10.20.193.91:0/733764906 conn(0x7fe1a80ecb30 msgr2=0x7fe1a810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:46.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/733764906 shutdown_connections 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/733764906 wait complete. 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.618+0000 7fe1b09e96c0 1 Processor -- start 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 -- start start 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a810f230 0x7fe1a811d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a811d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a8122b10 0x7fe1a8122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8123520 con 0x7fe1a8115440 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8123690 con 0x7fe1a8122b10 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8123850 con 0x7fe1a810f230 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a811d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a811d750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36540/0 (socket says 10.20.193.91:36540) 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 -- 10.20.193.91:0/4132404963 learned_addr learned my addr 10.20.193.91:0/4132404963 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1ae75a6c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a810f230 0x7fe1a811d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 -- 10.20.193.91:0/4132404963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a810f230 msgr2=0x7fe1a811d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a810f230 0x7fe1a811d210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 -- 10.20.193.91:0/4132404963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a8122b10 msgr2=0x7fe1a8122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a8122b10 0x7fe1a8122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 -- 10.20.193.91:0/4132404963 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c00a660 con 0x7fe1a8115440 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1adf596c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a811d750 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe194005dc0 tx=0x7fe19400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe194004250 con 0x7fe1a8115440 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a8163d00 con 0x7fe1a8115440 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe194009070 con 0x7fe1a8115440 2026-02-13T01:26:46.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe19400cd50 con 0x7fe1a8115440 2026-02-13T01:26:46.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.619+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a8164190 con 0x7fe1a8115440 2026-02-13T01:26:46.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.620+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a8110500 con 0x7fe1a8115440 2026-02-13T01:26:46.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.621+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe1940028c0 con 0x7fe1a8115440 2026-02-13T01:26:46.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.621+0000 7fe1937fe6c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1840b5650 0x7fe1840d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:46.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.622+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fe1940e3ca0 con 0x7fe1a8115440 2026-02-13T01:26:46.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.622+0000 7fe1ae75a6c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1840b5650 0x7fe1840d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:46.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.622+0000 7fe1ae75a6c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1840b5650 0x7fe1840d5b00 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a0005fd0 tx=0x7fe1a0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:46.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.622+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe1940a6640 con 0x7fe1a8115440 2026-02-13T01:26:46.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.739+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe1a810fc20 con 0x7fe1a8115440 2026-02-13T01:26:46.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.739+0000 7fe1937fe6c0 1 -- 10.20.193.91:0/4132404963 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe1940a97f0 con 0x7fe1a8115440 2026-02-13T01:26:46.740 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:46.740 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:46.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1840b5650 msgr2=0x7fe1840d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1840b5650 0x7fe1840d5b00 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1a0005fd0 tx=0x7fe1a0005910 comp rx=0 tx=0).stop 2026-02-13T01:26:46.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 msgr2=0x7fe1a811d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:46.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a811d750 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe194005dc0 tx=0x7fe19400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 shutdown_connections 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe1840b5650 0x7fe1840d5b00 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1a8122b10 0x7fe1a8122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe1a8115440 0x7fe1a811d750 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 --2- 10.20.193.91:0/4132404963 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe1a810f230 0x7fe1a811d210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 >> 10.20.193.91:0/4132404963 conn(0x7fe1a80ecb30 msgr2=0x7fe1a810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 shutdown_connections 2026-02-13T01:26:46.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:46.740+0000 7fe1b09e96c0 1 -- 10.20.193.91:0/4132404963 wait complete. 2026-02-13T01:26:47.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:47 trial154 ceph-mon[27045]: pgmap v226: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:47.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:47 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4132404963' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:47.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:47 trial091 ceph-mon[25068]: pgmap v226: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:47.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:47 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4132404963' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:47.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:47 trial126 ceph-mon[26569]: pgmap v226: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:47.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:47 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4132404963' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:49.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:49 trial154 ceph-mon[27045]: pgmap v227: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:49.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:49 trial091 ceph-mon[25068]: pgmap v227: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:49.781 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:49.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:49 trial126 ceph-mon[26569]: pgmap v227: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:49.900 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:50.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- 10.20.193.91:0/3809297020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0115410 msgr2=0x7f4cb0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/3809297020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0115410 0x7f4cb0175db0 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=8334726996984602807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ca400aa70 tx=0x7f4ca402fde0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- 10.20.193.91:0/3809297020 shutdown_connections 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/3809297020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0115410 0x7f4cb0175db0 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=8334726996984602807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/3809297020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4cb010fbf0 0x7f4cb0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/3809297020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb010f200 0x7f4cb010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- 10.20.193.91:0/3809297020 >> 10.20.193.91:0/3809297020 conn(0x7f4cb00ecb00 msgr2=0x7f4cb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- 10.20.193.91:0/3809297020 shutdown_connections 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- 10.20.193.91:0/3809297020 wait complete. 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 Processor -- start 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- start start 2026-02-13T01:26:50.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4cb010f200 0x7f4cb011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb0115410 0x7f4cb011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 0x7f4cb0122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0123560 con 0x7f4cb0122b50 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb01236d0 con 0x7f4cb0115410 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4cb61436c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb0123890 con 0x7f4cb010f200 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 0x7f4cb0122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 0x7f4cb0122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45834/0 (socket says 10.20.193.91:45834) 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 -- 10.20.193.91:0/238926125 learned_addr learned my addr 10.20.193.91:0/238926125 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caf7fe6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4cb010f200 0x7f4cb011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caeffd6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb0115410 0x7f4cb011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 -- 10.20.193.91:0/238926125 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4cb010f200 msgr2=0x7f4cb011d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4cb010f200 0x7f4cb011d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 -- 10.20.193.91:0/238926125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb0115410 msgr2=0x7f4cb011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb0115410 0x7f4cb011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 -- 10.20.193.91:0/238926125 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca400a660 con 0x7f4cb0122b50 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caeffd6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb0115410 0x7f4cb011d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.014+0000 7f4caffff6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 0x7f4cb0122ff0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ca40054b0 tx=0x7f4ca40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.015+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ca4003a30 con 0x7f4cb0122b50 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.015+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4ca4003b90 con 0x7f4cb0122b50 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.015+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb0163ce0 con 0x7f4cb0122b50 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.015+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ca40382f0 con 0x7f4cb0122b50 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.015+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb0164110 con 0x7f4cb0122b50 2026-02-13T01:26:50.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.015+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb01104d0 con 0x7f4cb0122b50 2026-02-13T01:26:50.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.016+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4ca4008260 con 0x7f4cb0122b50 2026-02-13T01:26:50.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.017+0000 7f4cacff96c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4c840b56d0 0x7f4c840d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:50.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.017+0000 7f4caf7fe6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4c840b56d0 0x7f4c840d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:50.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.017+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f4ca4108fc0 con 0x7f4cb0122b50 2026-02-13T01:26:50.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.017+0000 7f4caf7fe6c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4c840b56d0 0x7f4c840d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c9c005980 tx=0x7f4c9c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:50.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.018+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4ca40cb960 con 0x7f4cb0122b50 2026-02-13T01:26:50.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.132+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4cb010f5d0 con 0x7f4cb0122b50 2026-02-13T01:26:50.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.133+0000 7f4cacff96c0 1 -- 10.20.193.91:0/238926125 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4ca40ceb10 con 0x7f4cb0122b50 2026-02-13T01:26:50.132 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:50.133 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4c840b56d0 msgr2=0x7f4c840d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4c840b56d0 0x7f4c840d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4c9c005980 tx=0x7f4c9c005910 comp rx=0 tx=0).stop 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 msgr2=0x7f4cb0122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 0x7f4cb0122ff0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ca40054b0 tx=0x7f4ca40054e0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 shutdown_connections 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4c840b56d0 0x7f4c840d5b80 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4cb0122b50 0x7f4cb0122ff0 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4cb0115410 0x7f4cb011d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 --2- 10.20.193.91:0/238926125 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4cb010f200 0x7f4cb011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:50.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 >> 10.20.193.91:0/238926125 conn(0x7f4cb00ecb00 msgr2=0x7f4cb010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:50.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 shutdown_connections 2026-02-13T01:26:50.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:50.134+0000 7f4cb61436c0 1 -- 10.20.193.91:0/238926125 wait complete. 2026-02-13T01:26:50.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:50 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/238926125' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:50.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:50 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/238926125' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:50.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:50 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/238926125' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:51.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:51 trial154 ceph-mon[27045]: pgmap v228: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:51.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:51 trial091 ceph-mon[25068]: pgmap v228: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:51.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:51 trial126 ceph-mon[26569]: pgmap v228: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:53.174 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:53.291 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:53.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- 10.20.193.91:0/672962348 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f069810f200 msgr2=0x7f069810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- 10.20.193.91:0/672962348 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f069810f200 0x7f069810f5d0 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=5730119147334014746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06880099a0 tx=0x7f068802ed20 comp rx=0 tx=0).stop 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- 10.20.193.91:0/672962348 shutdown_connections 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- 10.20.193.91:0/672962348 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0698115410 0x7f0698175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- 10.20.193.91:0/672962348 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f069810fbf0 0x7f0698114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- 10.20.193.91:0/672962348 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f069810f200 0x7f069810f5d0 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=5730119147334014746 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- 10.20.193.91:0/672962348 >> 10.20.193.91:0/672962348 conn(0x7f06980ecb00 msgr2=0x7f069810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- 10.20.193.91:0/672962348 shutdown_connections 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- 10.20.193.91:0/672962348 wait complete. 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 Processor -- start 2026-02-13T01:26:53.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- start start 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f069810f200 0x7f069811d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 0x7f069811d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0698122b60 0x7f0698123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0698123570 con 0x7f0698115410 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f06981236e0 con 0x7f0698122b60 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.406+0000 7f069ff806c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06981238a0 con 0x7f069810f200 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 0x7f069811d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 0x7f069811d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45842/0 (socket says 10.20.193.91:45842) 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 -- 10.20.193.91:0/2688722846 learned_addr learned my addr 10.20.193.91:0/2688722846 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069dcf56c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f069810f200 0x7f069811d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:53.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069e4f66c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0698122b60 0x7f0698123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 -- 10.20.193.91:0/2688722846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f069810f200 msgr2=0x7f069811d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f069810f200 0x7f069811d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 -- 10.20.193.91:0/2688722846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0698122b60 msgr2=0x7f0698123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0698122b60 0x7f0698123000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 -- 10.20.193.91:0/2688722846 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0688009590 con 0x7f0698115410 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069d4f46c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 0x7f069811d7a0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f068c00b750 tx=0x7f068c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f068c004a80 con 0x7f0698115410 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f068c009030 con 0x7f0698115410 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0698163d50 con 0x7f0698115410 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f068c00cd00 con 0x7f0698115410 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06981641e0 con 0x7f0698115410 2026-02-13T01:26:53.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.407+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06981104d0 con 0x7f0698115410 2026-02-13T01:26:53.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.409+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f068c005020 con 0x7f0698115410 2026-02-13T01:26:53.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.410+0000 7f0686ffd6c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f06740b5650 0x7f06740d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:53.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.410+0000 7f069dcf56c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f06740b5650 0x7f06740d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:53.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.410+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f068c0e3c40 con 0x7f0698115410 2026-02-13T01:26:53.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.410+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f068c0e4130 con 0x7f0698115410 2026-02-13T01:26:53.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.410+0000 7f069dcf56c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f06740b5650 0x7f06740d5b00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06880023e0 tx=0x7f0688005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:53.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:53 trial091 ceph-mon[25068]: pgmap v229: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:53.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.525+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f069811e3b0 con 0x7f0698115410 2026-02-13T01:26:53.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.525+0000 7f0686ffd6c0 1 -- 10.20.193.91:0/2688722846 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f068c0a6620 con 0x7f0698115410 2026-02-13T01:26:53.527 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:53.527 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:53.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f06740b5650 msgr2=0x7f06740d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:53.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f06740b5650 0x7f06740d5b00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06880023e0 tx=0x7f0688005c60 comp rx=0 tx=0).stop 2026-02-13T01:26:53.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 msgr2=0x7f069811d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:53.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 0x7f069811d7a0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f068c00b750 tx=0x7f068c00bc20 comp rx=0 tx=0).stop 2026-02-13T01:26:53.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 shutdown_connections 2026-02-13T01:26:53.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f06740b5650 0x7f06740d5b00 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0698122b60 0x7f0698123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0698115410 0x7f069811d7a0 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 --2- 10.20.193.91:0/2688722846 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f069810f200 0x7f069811d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:53.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 >> 10.20.193.91:0/2688722846 conn(0x7f06980ecb00 msgr2=0x7f069810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:53.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 shutdown_connections 2026-02-13T01:26:53.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:53.526+0000 7f069ff806c0 1 -- 10.20.193.91:0/2688722846 wait complete. 2026-02-13T01:26:53.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:53 trial154 ceph-mon[27045]: pgmap v229: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:53 trial126 ceph-mon[26569]: pgmap v229: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:54.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:54 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2688722846' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:54.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:54 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2688722846' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:54 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2688722846' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:55.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:55 trial154 ceph-mon[27045]: pgmap v230: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:26:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:55 trial091 ceph-mon[25068]: pgmap v230: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:26:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:55 trial126 ceph-mon[26569]: pgmap v230: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:26:56.567 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:26:56.685 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:26:56.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1477462378 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a4060200 msgr2=0x7f03a41129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:56.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1477462378 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a4060200 0x7f03a41129e0 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=13205682755179053613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03940099a0 tx=0x7f039402ed50 comp rx=0 tx=0).stop 2026-02-13T01:26:56.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1477462378 shutdown_connections 2026-02-13T01:26:56.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1477462378 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03a41131c0 0x7f03a4173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1477462378 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a4060200 0x7f03a41129e0 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=13205682755179053613 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1477462378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03a405f810 0x7f03a405fbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1477462378 >> 10.20.193.91:0/1477462378 conn(0x7f03a40e9770 msgr2=0x7f03a4109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1477462378 shutdown_connections 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1477462378 wait complete. 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 Processor -- start 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- start start 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 0x7f03a410bc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03a41131c0 0x7f03a4173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:56.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03a410c150 0x7f03a410c5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f03a410db50 con 0x7f03a405f810 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40f9bb0 con 0x7f03a41131c0 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03aa35f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40f9d70 con 0x7f03a410c150 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03a3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 0x7f03a410bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03a3fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 0x7f03a410bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45858/0 (socket says 10.20.193.91:45858) 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03a3fff6c0 1 -- 10.20.193.91:0/1344535314 learned_addr learned my addr 10.20.193.91:0/1344535314 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.802+0000 7f03a88d16c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03a410c150 0x7f03a410c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a3fff6c0 1 -- 10.20.193.91:0/1344535314 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03a410c150 msgr2=0x7f03a410c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a3fff6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03a410c150 0x7f03a410c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a3fff6c0 1 -- 10.20.193.91:0/1344535314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03a41131c0 msgr2=0x7f03a4173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a3fff6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03a41131c0 0x7f03a4173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a3fff6c0 1 -- 10.20.193.91:0/1344535314 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0394009590 con 0x7f03a405f810 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a3fff6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 0x7f03a410bc10 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f039000b710 tx=0x7f039000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0390004250 con 0x7f03a405f810 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a40fa050 con 0x7f03a405f810 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0390002d80 con 0x7f03a405f810 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f039000cdc0 con 0x7f03a405f810 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a40fa530 con 0x7f03a405f810 2026-02-13T01:26:56.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.803+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a410e280 con 0x7f03a405f810 2026-02-13T01:26:56.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.804+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f03900028c0 con 0x7f03a405f810 2026-02-13T01:26:56.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.805+0000 7f03a17fa6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03780b5650 0x7f03780d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:26:56.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.805+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f03900e3ce0 con 0x7f03a405f810 2026-02-13T01:26:56.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.805+0000 7f03a37fe6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03780b5650 0x7f03780d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:26:56.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.805+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f03900a6680 con 0x7f03a405f810 2026-02-13T01:26:56.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.805+0000 7f03a37fe6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03780b5650 0x7f03780d5b00 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03940098c0 tx=0x7f0394005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:26:56.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.920+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f03a405fbe0 con 0x7f03a405f810 2026-02-13T01:26:56.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.920+0000 7f03a17fa6c0 1 -- 10.20.193.91:0/1344535314 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f03900a9830 con 0x7f03a405f810 2026-02-13T01:26:56.921 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:26:56.921 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:26:56.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03780b5650 msgr2=0x7f03780d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:56.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03780b5650 0x7f03780d5b00 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03940098c0 tx=0x7f0394005c00 comp rx=0 tx=0).stop 2026-02-13T01:26:56.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 msgr2=0x7f03a410bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 0x7f03a410bc10 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f039000b710 tx=0x7f039000bbe0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 shutdown_connections 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03780b5650 0x7f03780d5b00 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f03a410c150 0x7f03a410c5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03a41131c0 0x7f03a4173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 --2- 10.20.193.91:0/1344535314 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f03a405f810 0x7f03a410bc10 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 >> 10.20.193.91:0/1344535314 conn(0x7f03a40e9770 msgr2=0x7f03a410a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 shutdown_connections 2026-02-13T01:26:56.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:26:56.921+0000 7f03aa35f6c0 1 -- 10.20.193.91:0/1344535314 wait complete. 2026-02-13T01:26:57.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:57 trial154 ceph-mon[27045]: pgmap v231: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:57.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:57 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1344535314' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:57.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:57 trial091 ceph-mon[25068]: pgmap v231: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:57.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:57 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1344535314' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:57.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:57 trial126 ceph-mon[26569]: pgmap v231: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:26:57.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:57 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1344535314' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:26:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:26:59 trial154 ceph-mon[27045]: pgmap v232: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:59.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:26:59 trial091 ceph-mon[25068]: pgmap v232: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:59.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:26:59 trial126 ceph-mon[26569]: pgmap v232: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:26:59.963 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:00.082 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:00.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/3716284028 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d010f230 msgr2=0x7fc7d010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/3716284028 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d010f230 0x7fc7d010f600 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=12422719878390619745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7bc0099a0 tx=0x7fc7bc02ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/3716284028 shutdown_connections 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/3716284028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d0115440 0x7fc7d0175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/3716284028 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc7d010fc20 0x7fc7d0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/3716284028 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d010f230 0x7fc7d010f600 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=12422719878390619745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/3716284028 >> 10.20.193.91:0/3716284028 conn(0x7fc7d00ecb30 msgr2=0x7fc7d010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/3716284028 shutdown_connections 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/3716284028 wait complete. 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 Processor -- start 2026-02-13T01:27:00.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- start start 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d010f230 0x7fc7d011d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 0x7fc7d011d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc7d0122c20 0x7fc7d01230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0123600 con 0x7fc7d0115440 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0123770 con 0x7fc7d010f230 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7d639c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0123930 con 0x7fc7d0122c20 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7cf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 0x7fc7d011d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7cf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 0x7fc7d011d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44560/0 (socket says 10.20.193.91:44560) 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.203+0000 7fc7cf7fe6c0 1 -- 10.20.193.91:0/2840636824 learned_addr learned my addr 10.20.193.91:0/2840636824 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7d49126c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc7d0122c20 0x7fc7d01230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cf7fe6c0 1 -- 10.20.193.91:0/2840636824 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc7d0122c20 msgr2=0x7fc7d01230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:00.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cf7fe6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc7d0122c20 0x7fc7d01230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cffff6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d010f230 0x7fc7d011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cf7fe6c0 1 -- 10.20.193.91:0/2840636824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d010f230 msgr2=0x7fc7d011d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cf7fe6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d010f230 0x7fc7d011d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cf7fe6c0 1 -- 10.20.193.91:0/2840636824 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc009590 con 0x7fc7d0115440 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cffff6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d010f230 0x7fc7d011d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cf7fe6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 0x7fc7d011d860 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7c000b650 tx=0x7fc7c000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7c00044a0 con 0x7fc7d0115440 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d0163db0 con 0x7fc7d0115440 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc7c0009030 con 0x7fc7d0115440 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc7c000cc10 con 0x7fc7d0115440 2026-02-13T01:27:00.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d01642e0 con 0x7fc7d0115440 2026-02-13T01:27:00.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.204+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d0110500 con 0x7fc7d0115440 2026-02-13T01:27:00.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.205+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fc7c00026b0 con 0x7fc7d0115440 2026-02-13T01:27:00.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.206+0000 7fc7cd7fa6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc7a40b5650 0x7fc7a40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:00.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.206+0000 7fc7cffff6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc7a40b5650 0x7fc7a40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:00.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.206+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fc7c00e3b80 con 0x7fc7d0115440 2026-02-13T01:27:00.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.206+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc7c00a6520 con 0x7fc7d0115440 2026-02-13T01:27:00.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.206+0000 7fc7cffff6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc7a40b5650 0x7fc7a40d5b00 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7bc0098c0 tx=0x7fc7bc02f580 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:00.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.322+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc7d011e470 con 0x7fc7d0115440 2026-02-13T01:27:00.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.322+0000 7fc7cd7fa6c0 1 -- 10.20.193.91:0/2840636824 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc7c00a96d0 con 0x7fc7d0115440 2026-02-13T01:27:00.324 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:00.324 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:00.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc7a40b5650 msgr2=0x7fc7a40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc7a40b5650 0x7fc7a40d5b00 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7bc0098c0 tx=0x7fc7bc02f580 comp rx=0 tx=0).stop 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 msgr2=0x7fc7d011d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 0x7fc7d011d860 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc7c000b650 tx=0x7fc7c000bb20 comp rx=0 tx=0).stop 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 shutdown_connections 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fc7a40b5650 0x7fc7a40d5b00 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fc7d0122c20 0x7fc7d01230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fc7d0115440 0x7fc7d011d860 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 --2- 10.20.193.91:0/2840636824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc7d010f230 0x7fc7d011d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 >> 10.20.193.91:0/2840636824 conn(0x7fc7d00ecb30 msgr2=0x7fc7d010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:00.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 shutdown_connections 2026-02-13T01:27:00.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:00.323+0000 7fc7d639c6c0 1 -- 10.20.193.91:0/2840636824 wait complete. 2026-02-13T01:27:00.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:00 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2840636824' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:00.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:00 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2840636824' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:00 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2840636824' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:01.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:01 trial154 ceph-mon[27045]: pgmap v233: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:01.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:01 trial091 ceph-mon[25068]: pgmap v233: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:01.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:01 trial126 ceph-mon[26569]: pgmap v233: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:03.363 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:03.486 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:03.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/2410705377 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f9810f200 msgr2=0x7f8f9810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/2410705377 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f9810f200 0x7f8f9810f5d0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=1868898684502913994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f8c0099a0 tx=0x7f8f8c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/2410705377 shutdown_connections 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/2410705377 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98115410 0x7f8f98175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/2410705377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f9810fbf0 0x7f8f98114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/2410705377 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f9810f200 0x7f8f9810f5d0 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=1868898684502913994 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/2410705377 >> 10.20.193.91:0/2410705377 conn(0x7f8f980ecb00 msgr2=0x7f8f9810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/2410705377 shutdown_connections 2026-02-13T01:27:03.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/2410705377 wait complete. 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 Processor -- start 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- start start 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f9810f200 0x7f8f9811d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 0x7f8f9811d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98122c50 0x7f8f981230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98123630 con 0x7f8f98115410 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f981237a0 con 0x7f8f9810f200 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f9d8d86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8f98123960 con 0x7f8f98122c50 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 0x7f8f9811d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:03.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 0x7f8f9811d890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44580/0 (socket says 10.20.193.91:44580) 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 -- 10.20.193.91:0/1656363189 learned_addr learned my addr 10.20.193.91:0/1656363189 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f96ffd6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f9810f200 0x7f8f9811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f977fe6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98122c50 0x7f8f981230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 -- 10.20.193.91:0/1656363189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98122c50 msgr2=0x7f8f981230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98122c50 0x7f8f981230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 -- 10.20.193.91:0/1656363189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f9810f200 msgr2=0x7f8f9811d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f9810f200 0x7f8f9811d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 -- 10.20.193.91:0/1656363189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c009590 con 0x7f8f98115410 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f977fe6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98122c50 0x7f8f981230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.592+0000 7f8f967fc6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 0x7f8f9811d890 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f8000b650 tx=0x7f8f8000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.593+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f800044a0 con 0x7f8f98115410 2026-02-13T01:27:03.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.593+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f98163de0 con 0x7f8f98115410 2026-02-13T01:27:03.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.593+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8f80009030 con 0x7f8f98115410 2026-02-13T01:27:03.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.593+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8f8000cc10 con 0x7f8f98115410 2026-02-13T01:27:03.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.593+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f98164310 con 0x7f8f98115410 2026-02-13T01:27:03.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.593+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f981104d0 con 0x7f8f98115410 2026-02-13T01:27:03.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.595+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8f800026b0 con 0x7f8f98115410 2026-02-13T01:27:03.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.595+0000 7f8f9c8d26c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f6c0b56d0 0x7f8f6c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:03.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.595+0000 7f8f96ffd6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f6c0b56d0 0x7f8f6c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:03.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.596+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f8f800e3a60 con 0x7f8f98115410 2026-02-13T01:27:03.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.596+0000 7f8f96ffd6c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f6c0b56d0 0x7f8f6c0d5b80 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f8c005b40 tx=0x7f8f8c0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:03.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.596+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8f8011c5e0 con 0x7f8f98115410 2026-02-13T01:27:03.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.711+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f9811e4a0 con 0x7f8f98115410 2026-02-13T01:27:03.712 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:03 trial091 ceph-mon[25068]: pgmap v234: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:03.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.711+0000 7f8f9c8d26c0 1 -- 10.20.193.91:0/1656363189 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8f800a6400 con 0x7f8f98115410 2026-02-13T01:27:03.713 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:03.713 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f6c0b56d0 msgr2=0x7f8f6c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f6c0b56d0 0x7f8f6c0d5b80 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f8c005b40 tx=0x7f8f8c0023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 msgr2=0x7f8f9811d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 0x7f8f9811d890 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f8000b650 tx=0x7f8f8000bb20 comp rx=0 tx=0).stop 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 shutdown_connections 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8f6c0b56d0 0x7f8f6c0d5b80 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8f98122c50 0x7f8f981230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8f98115410 0x7f8f9811d890 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 --2- 10.20.193.91:0/1656363189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f9810f200 0x7f8f9811d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:03.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 >> 10.20.193.91:0/1656363189 conn(0x7f8f980ecb00 msgr2=0x7f8f9810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:03.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 shutdown_connections 2026-02-13T01:27:03.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:03.712+0000 7f8f9d8d86c0 1 -- 10.20.193.91:0/1656363189 wait complete. 2026-02-13T01:27:03.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:03 trial154 ceph-mon[27045]: pgmap v234: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:03 trial126 ceph-mon[26569]: pgmap v234: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:04.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:04 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1656363189' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:04.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:04 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1656363189' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:04 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1656363189' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:05.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:05 trial154 ceph-mon[27045]: pgmap v235: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:05 trial091 ceph-mon[25068]: pgmap v235: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:05 trial126 ceph-mon[26569]: pgmap v235: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:06.753 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:06.871 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:06.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.994+0000 7ff922ae06c0 1 -- 10.20.193.91:0/2104403420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c10fc20 msgr2=0x7ff91c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.994+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/2104403420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c10fc20 0x7ff91c114c60 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=8432405924097763110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040099a0 tx=0x7ff90402ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:06.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- 10.20.193.91:0/2104403420 shutdown_connections 2026-02-13T01:27:06.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/2104403420 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff91c115440 0x7ff91c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/2104403420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c10fc20 0x7ff91c114c60 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=8432405924097763110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/2104403420 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff91c10f230 0x7ff91c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- 10.20.193.91:0/2104403420 >> 10.20.193.91:0/2104403420 conn(0x7ff91c0ecb30 msgr2=0x7ff91c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- 10.20.193.91:0/2104403420 shutdown_connections 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- 10.20.193.91:0/2104403420 wait complete. 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 Processor -- start 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- start start 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff91c10f230 0x7ff91c0f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 0x7ff91c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff91c0f5330 0x7ff91c0fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c0f5a20 con 0x7ff91c115440 2026-02-13T01:27:06.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c0faaf0 con 0x7ff91c0f5330 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c0facb0 con 0x7ff91c10f230 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 0x7ff91c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 0x7ff91c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44600/0 (socket says 10.20.193.91:44600) 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 -- 10.20.193.91:0/1473644494 learned_addr learned my addr 10.20.193.91:0/1473644494 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff9210566c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff91c0f5330 0x7ff91c0fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff9208556c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff91c10f230 0x7ff91c0f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 -- 10.20.193.91:0/1473644494 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff91c10f230 msgr2=0x7ff91c0f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff91c10f230 0x7ff91c0f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 -- 10.20.193.91:0/1473644494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff91c0f5330 msgr2=0x7ff91c0fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff91c0f5330 0x7ff91c0fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 -- 10.20.193.91:0/1473644494 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff904009590 con 0x7ff91c115440 2026-02-13T01:27:06.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff913fff6c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 0x7ff91c175ce0 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040023c0 tx=0x7ff90402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:07.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff904002ae0 con 0x7ff91c115440 2026-02-13T01:27:07.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.995+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91c0faf30 con 0x7ff91c115440 2026-02-13T01:27:07.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.996+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff904007680 con 0x7ff91c115440 2026-02-13T01:27:07.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.996+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9040374d0 con 0x7ff91c115440 2026-02-13T01:27:07.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.996+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91c0fb400 con 0x7ff91c115440 2026-02-13T01:27:07.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.996+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91c110500 con 0x7ff91c115440 2026-02-13T01:27:07.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.997+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff904007cb0 con 0x7ff91c115440 2026-02-13T01:27:07.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.998+0000 7ff911ffb6c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8f80b5650 0x7ff8f80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:07.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.998+0000 7ff9208556c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8f80b5650 0x7ff8f80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:07.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.998+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff904107ce0 con 0x7ff91c115440 2026-02-13T01:27:07.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.998+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff9040ce120 con 0x7ff91c115440 2026-02-13T01:27:07.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:06.998+0000 7ff9208556c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8f80b5650 0x7ff8f80d5b00 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff90c005980 tx=0x7ff90c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:07.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.113+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff91c0f5e00 con 0x7ff91c115440 2026-02-13T01:27:07.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.114+0000 7ff911ffb6c0 1 -- 10.20.193.91:0/1473644494 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff9040d0190 con 0x7ff91c115440 2026-02-13T01:27:07.115 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:07.115 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:07.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8f80b5650 msgr2=0x7ff8f80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:07.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8f80b5650 0x7ff8f80d5b00 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff90c005980 tx=0x7ff90c005910 comp rx=0 tx=0).stop 2026-02-13T01:27:07.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 msgr2=0x7ff91c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:07.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 0x7ff91c175ce0 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040023c0 tx=0x7ff90402fbf0 comp rx=0 tx=0).stop 2026-02-13T01:27:07.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 shutdown_connections 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8f80b5650 0x7ff8f80d5b00 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff91c0f5330 0x7ff91c0fa5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff91c115440 0x7ff91c175ce0 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 --2- 10.20.193.91:0/1473644494 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff91c10f230 0x7ff91c0f4d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 >> 10.20.193.91:0/1473644494 conn(0x7ff91c0ecb30 msgr2=0x7ff91c10d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 shutdown_connections 2026-02-13T01:27:07.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:07.115+0000 7ff922ae06c0 1 -- 10.20.193.91:0/1473644494 wait complete. 2026-02-13T01:27:07.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:07 trial154 ceph-mon[27045]: pgmap v236: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:07.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:07 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1473644494' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:07.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:07 trial091 ceph-mon[25068]: pgmap v236: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:07.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:07 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1473644494' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:07 trial126 ceph-mon[26569]: pgmap v236: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:07 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1473644494' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:09.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:09 trial154 ceph-mon[27045]: pgmap v237: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:27:09.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:09 trial091 ceph-mon[25068]: pgmap v237: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:27:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:09 trial126 ceph-mon[26569]: pgmap v237: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 9 op/s 2026-02-13T01:27:10.156 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:10.279 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 -- 10.20.193.91:0/3995001712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 msgr2=0x7f3d30175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/3995001712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d30175db0 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=17195953284865250135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d2400aa70 tx=0x7f3d2402fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 -- 10.20.193.91:0/3995001712 shutdown_connections 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/3995001712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d30175db0 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=17195953284865250135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/3995001712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010fbf0 0x7f3d30114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/3995001712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d3010f200 0x7f3d3010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 -- 10.20.193.91:0/3995001712 >> 10.20.193.91:0/3995001712 conn(0x7f3d300ecb00 msgr2=0x7f3d3010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 -- 10.20.193.91:0/3995001712 shutdown_connections 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.389+0000 7f3d368a46c0 1 -- 10.20.193.91:0/3995001712 wait complete. 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 Processor -- start 2026-02-13T01:27:10.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 -- start start 2026-02-13T01:27:10.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010f200 0x7f3d3011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d3011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d30122b50 0x7f3d30122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f3d30123560 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d301236d0 con 0x7f3d30122b50 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d30123890 con 0x7f3d3010f200 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d3011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d3011d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:59446/0 (socket says 10.20.193.91:59446) 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 -- 10.20.193.91:0/1218950225 learned_addr learned my addr 10.20.193.91:0/1218950225 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2ffff6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010f200 0x7f3d3011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d34e166c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d30122b50 0x7f3d30122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 -- 10.20.193.91:0/1218950225 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010f200 msgr2=0x7f3d3011d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010f200 0x7f3d3011d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 -- 10.20.193.91:0/1218950225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d30122b50 msgr2=0x7f3d30122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d30122b50 0x7f3d30122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 -- 10.20.193.91:0/1218950225 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2400a660 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2ffff6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010f200 0x7f3d3011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2f7fe6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d3011d790 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d2000b6c0 tx=0x7f3d2000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d20004250 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3d20009070 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d30163d40 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d2000ccb0 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.390+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d301641d0 con 0x7f3d30115410 2026-02-13T01:27:10.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.391+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d301104d0 con 0x7f3d30115410 2026-02-13T01:27:10.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.392+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3d200028c0 con 0x7f3d30115410 2026-02-13T01:27:10.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.392+0000 7f3d2d7fa6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3d040b56d0 0x7f3d040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:10.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.392+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f3d200e3bf0 con 0x7f3d30115410 2026-02-13T01:27:10.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.393+0000 7f3d2ffff6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3d040b56d0 0x7f3d040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:10.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.393+0000 7f3d2ffff6c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3d040b56d0 0x7f3d040d5b80 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d1c004750 tx=0x7f3d1c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:10.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.393+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3d200a65d0 con 0x7f3d30115410 2026-02-13T01:27:10.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.508+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3d3010f5d0 con 0x7f3d30115410 2026-02-13T01:27:10.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.509+0000 7f3d2d7fa6c0 1 -- 10.20.193.91:0/1218950225 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3d200a9780 con 0x7f3d30115410 2026-02-13T01:27:10.509 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:10.509 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3d040b56d0 msgr2=0x7f3d040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3d040b56d0 0x7f3d040d5b80 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d1c004750 tx=0x7f3d1c009260 comp rx=0 tx=0).stop 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 msgr2=0x7f3d3011d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d3011d790 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d2000b6c0 tx=0x7f3d2000bb90 comp rx=0 tx=0).stop 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 shutdown_connections 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f3d040b56d0 0x7f3d040d5b80 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d30122b50 0x7f3d30122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3d30115410 0x7f3d3011d790 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 --2- 10.20.193.91:0/1218950225 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3d3010f200 0x7f3d3011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 >> 10.20.193.91:0/1218950225 conn(0x7f3d300ecb00 msgr2=0x7f3d3010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:10.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 shutdown_connections 2026-02-13T01:27:10.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:10.510+0000 7f3d368a46c0 1 -- 10.20.193.91:0/1218950225 wait complete. 2026-02-13T01:27:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:11 trial154 ceph-mon[27045]: pgmap v238: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:11 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1218950225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:11 trial091 ceph-mon[25068]: pgmap v238: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:11 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1218950225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:11 trial126 ceph-mon[26569]: pgmap v238: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:11 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1218950225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:12.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:12 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:12.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:12 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:12.754 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:12 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:27:13.549 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: pgmap v239: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.573 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:13 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.668 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: pgmap v239: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:13 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 -- 10.20.193.91:0/3614490890 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac10cf80 msgr2=0x7f50ac10d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/3614490890 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac10cf80 0x7f50ac10d350 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=12406012964820389573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a00099a0 tx=0x7f50a002ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 -- 10.20.193.91:0/3614490890 shutdown_connections 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/3614490890 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50ac113190 0x7f50ac173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/3614490890 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f50ac10d970 0x7f50ac1129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/3614490890 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac10cf80 0x7f50ac10d350 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=12406012964820389573 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 -- 10.20.193.91:0/3614490890 >> 10.20.193.91:0/3614490890 conn(0x7f50ac0ea880 msgr2=0x7f50ac10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 -- 10.20.193.91:0/3614490890 shutdown_connections 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.792+0000 7f50b154f6c0 1 -- 10.20.193.91:0/3614490890 wait complete. 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 Processor -- start 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 -- start start 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f50ac10cf80 0x7f50ac060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50ac113190 0x7f50ac060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 0x7f50ac163300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac163840 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac1639b0 con 0x7f50ac10cf80 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50ac163b70 con 0x7f50ac113190 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 0x7f50ac163300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 0x7f50ac163300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:59452/0 (socket says 10.20.193.91:59452) 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 -- 10.20.193.91:0/2620413557 learned_addr learned my addr 10.20.193.91:0/2620413557 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50aaffd6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f50ac10cf80 0x7f50ac060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50aa7fc6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50ac113190 0x7f50ac060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 -- 10.20.193.91:0/2620413557 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50ac113190 msgr2=0x7f50ac060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50ac113190 0x7f50ac060c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 -- 10.20.193.91:0/2620413557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f50ac10cf80 msgr2=0x7f50ac060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f50ac10cf80 0x7f50ac060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 -- 10.20.193.91:0/2620413557 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a0009590 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50ab7fe6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 0x7f50ac163300 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f509c006ea0 tx=0x7f509c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f509c003a30 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f509c0054f0 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ac163e50 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f509c00dcd0 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.793+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ac164380 con 0x7f50ac061180 2026-02-13T01:27:13.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.794+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ac10e250 con 0x7f50ac061180 2026-02-13T01:27:13.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.795+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f509c005030 con 0x7f50ac061180 2026-02-13T01:27:13.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.796+0000 7f508bfff6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50800b56d0 0x7f50800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:13.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.796+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f509c0e4c00 con 0x7f50ac061180 2026-02-13T01:27:13.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.796+0000 7f50aaffd6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50800b56d0 0x7f50800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:13.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.796+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f509c0e50f0 con 0x7f50ac061180 2026-02-13T01:27:13.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.796+0000 7f50aaffd6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50800b56d0 0x7f50800d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a00092e0 tx=0x7f50a0005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: pgmap v239: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:13 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:13.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.908+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50ac061a00 con 0x7f50ac061180 2026-02-13T01:27:13.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.908+0000 7f508bfff6c0 1 -- 10.20.193.91:0/2620413557 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f509c0a75e0 con 0x7f50ac061180 2026-02-13T01:27:13.909 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:13.909 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50800b56d0 msgr2=0x7f50800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50800b56d0 0x7f50800d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a00092e0 tx=0x7f50a0005c00 comp rx=0 tx=0).stop 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 msgr2=0x7f50ac163300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 0x7f50ac163300 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f509c006ea0 tx=0x7f509c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 shutdown_connections 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f50800b56d0 0x7f50800d5b80 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f50ac061180 0x7f50ac163300 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f50ac113190 0x7f50ac060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 --2- 10.20.193.91:0/2620413557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f50ac10cf80 0x7f50ac060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 >> 10.20.193.91:0/2620413557 conn(0x7f50ac0ea880 msgr2=0x7f50ac10ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 shutdown_connections 2026-02-13T01:27:13.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:13.909+0000 7f50b154f6c0 1 -- 10.20.193.91:0/2620413557 wait complete. 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: pgmap v240: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:14 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2620413557' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: pgmap v240: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:14 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2620413557' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: pgmap v240: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:27:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:14 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2620413557' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:15.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:15 trial126 ceph-mon[26569]: pgmap v241: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T01:27:15.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:15 trial154 ceph-mon[27045]: pgmap v241: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T01:27:15.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:15 trial091 ceph-mon[25068]: pgmap v241: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T01:27:16.950 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:17.069 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:17.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 -- 10.20.193.91:0/2617608568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f078810f200 msgr2=0x7f078810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 --2- 10.20.193.91:0/2617608568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f078810f200 0x7f078810f5d0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=3819561941213476363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f07780099a0 tx=0x7f077802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 -- 10.20.193.91:0/2617608568 shutdown_connections 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 --2- 10.20.193.91:0/2617608568 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0788115410 0x7f0788175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 --2- 10.20.193.91:0/2617608568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f078810fbf0 0x7f0788114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 --2- 10.20.193.91:0/2617608568 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f078810f200 0x7f078810f5d0 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=3819561941213476363 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 -- 10.20.193.91:0/2617608568 >> 10.20.193.91:0/2617608568 conn(0x7f07880ecb00 msgr2=0x7f078810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 -- 10.20.193.91:0/2617608568 shutdown_connections 2026-02-13T01:27:17.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 -- 10.20.193.91:0/2617608568 wait complete. 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 Processor -- start 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.181+0000 7f078edd46c0 1 -- start start 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f078810f200 0x7f078811d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0788115410 0x7f078811d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 0x7f07881230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0788123660 con 0x7f0788122c50 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f07881237d0 con 0x7f0788115410 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0788123990 con 0x7f078810f200 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 0x7f07881230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 0x7f07881230f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60320/0 (socket says 10.20.193.91:60320) 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 -- 10.20.193.91:0/436327608 learned_addr learned my addr 10.20.193.91:0/436327608 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078cb496c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f078810f200 0x7f078811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f077ffff6c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0788115410 0x7f078811d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 -- 10.20.193.91:0/436327608 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f078810f200 msgr2=0x7f078811d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f078810f200 0x7f078811d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 -- 10.20.193.91:0/436327608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0788115410 msgr2=0x7f078811d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0788115410 0x7f078811d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 -- 10.20.193.91:0/436327608 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0778009590 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f077ffff6c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0788115410 0x7f078811d890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078d34a6c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 0x7f07881230f0 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0784006ea0 tx=0x7f078400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0784003a30 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f07840054f0 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f078400dcd0 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0788163e40 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.182+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07881642d0 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.183+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07881104d0 con 0x7f0788122c50 2026-02-13T01:27:17.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.184+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0784005030 con 0x7f0788122c50 2026-02-13T01:27:17.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.185+0000 7f077dffb6c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f07640b56d0 0x7f07640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:17.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.185+0000 7f078cb496c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f07640b56d0 0x7f07640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:17.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.185+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f07840e4b90 con 0x7f0788122c50 2026-02-13T01:27:17.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.185+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f07840aa6e0 con 0x7f0788122c50 2026-02-13T01:27:17.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.185+0000 7f078cb496c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f07640b56d0 0x7f07640d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0778005b40 tx=0x7f07780023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:17.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.299+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f078810f5d0 con 0x7f0788122c50 2026-02-13T01:27:17.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f077dffb6c0 1 -- 10.20.193.91:0/436327608 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f07840aa8c0 con 0x7f0788122c50 2026-02-13T01:27:17.300 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:17.300 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:17.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f07640b56d0 msgr2=0x7f07640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f07640b56d0 0x7f07640d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0778005b40 tx=0x7f07780023a0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 msgr2=0x7f07881230f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:17.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 0x7f07881230f0 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0784006ea0 tx=0x7f078400cca0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 shutdown_connections 2026-02-13T01:27:17.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f07640b56d0 0x7f07640d5b80 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0788122c50 0x7f07881230f0 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0788115410 0x7f078811d890 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 --2- 10.20.193.91:0/436327608 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f078810f200 0x7f078811d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:17.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.300+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 >> 10.20.193.91:0/436327608 conn(0x7f07880ecb00 msgr2=0x7f078810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:17.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.301+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 shutdown_connections 2026-02-13T01:27:17.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:17.301+0000 7f078edd46c0 1 -- 10.20.193.91:0/436327608 wait complete. 2026-02-13T01:27:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:17 trial091 ceph-mon[25068]: pgmap v242: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T01:27:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:17 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/436327608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:17.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:17 trial126 ceph-mon[26569]: pgmap v242: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T01:27:17.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:17 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/436327608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:17 trial154 ceph-mon[27045]: pgmap v242: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T01:27:17.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:17 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/436327608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:19.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:19 trial126 ceph-mon[26569]: pgmap v243: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:19.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:19 trial154 ceph-mon[27045]: pgmap v243: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:19.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:19 trial091 ceph-mon[25068]: pgmap v243: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:20.343 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:20.463 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:20.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- 10.20.193.91:0/1846881528 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 msgr2=0x7fa97410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- 10.20.193.91:0/1846881528 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97410f600 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=102453342463091891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9680099a0 tx=0x7fa96802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:20.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- 10.20.193.91:0/1846881528 shutdown_connections 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- 10.20.193.91:0/1846881528 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 0x7fa974175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- 10.20.193.91:0/1846881528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa97410fc20 0x7fa974114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- 10.20.193.91:0/1846881528 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97410f600 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=102453342463091891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- 10.20.193.91:0/1846881528 >> 10.20.193.91:0/1846881528 conn(0x7fa9740ecb30 msgr2=0x7fa97410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- 10.20.193.91:0/1846881528 shutdown_connections 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- 10.20.193.91:0/1846881528 wait complete. 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 Processor -- start 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- start start 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97411d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 0x7fa97411d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa974122cb0 0x7fa974123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa9741236c0 con 0x7fa97410f230 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa974123830 con 0x7fa974122cb0 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa979a146c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9741239f0 con 0x7fa974115440 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97411d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60332/0 (socket says 10.20.193.91:60332) 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 -- 10.20.193.91:0/3765997661 learned_addr learned my addr 10.20.193.91:0/3765997661 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa9727fc6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 0x7fa97411d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 -- 10.20.193.91:0/3765997661 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 msgr2=0x7fa97411d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 0x7fa97411d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 -- 10.20.193.91:0/3765997661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa974122cb0 msgr2=0x7fa974123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa974122cb0 0x7fa974123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa972ffd6c0 1 -- 10.20.193.91:0/3765997661 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa968009590 con 0x7fa97410f230 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.580+0000 7fa9727fc6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 0x7fa97411d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa972ffd6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97411d3b0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa96802f230 tx=0x7fa96802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa968002ba0 con 0x7fa97410f230 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa968002d00 con 0x7fa97410f230 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9680372f0 con 0x7fa97410f230 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa974163e40 con 0x7fa97410f230 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa974164270 con 0x7fa97410f230 2026-02-13T01:27:20.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.581+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa974110500 con 0x7fa97410f230 2026-02-13T01:27:20.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.583+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa9680078d0 con 0x7fa97410f230 2026-02-13T01:27:20.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.583+0000 7fa978a126c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa9480b56d0 0x7fa9480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:20.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.583+0000 7fa9727fc6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa9480b56d0 0x7fa9480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:20.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.583+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fa968107cd0 con 0x7fa97410f230 2026-02-13T01:27:20.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.583+0000 7fa9727fc6c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa9480b56d0 0x7fa9480d5b80 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa974123d40 tx=0x7fa95c005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:20.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.584+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa9680ca6b0 con 0x7fa97410f230 2026-02-13T01:27:20.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.701+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa97410f600 con 0x7fa97410f230 2026-02-13T01:27:20.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.701+0000 7fa978a126c0 1 -- 10.20.193.91:0/3765997661 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa9680cd860 con 0x7fa97410f230 2026-02-13T01:27:20.702 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:20.703 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa9480b56d0 msgr2=0x7fa9480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa9480b56d0 0x7fa9480d5b80 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa974123d40 tx=0x7fa95c005f10 comp rx=0 tx=0).stop 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 msgr2=0x7fa97411d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97411d3b0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa96802f230 tx=0x7fa96802fd40 comp rx=0 tx=0).stop 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 shutdown_connections 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa9480b56d0 0x7fa9480d5b80 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa974122cb0 0x7fa974123150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa974115440 0x7fa97411d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 --2- 10.20.193.91:0/3765997661 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa97410f230 0x7fa97411d3b0 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:20.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 >> 10.20.193.91:0/3765997661 conn(0x7fa9740ecb30 msgr2=0x7fa97410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:20.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 shutdown_connections 2026-02-13T01:27:20.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:20.703+0000 7fa979a146c0 1 -- 10.20.193.91:0/3765997661 wait complete. 2026-02-13T01:27:21.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:21 trial126 ceph-mon[26569]: pgmap v244: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:21.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:21 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3765997661' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:21.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:21 trial154 ceph-mon[27045]: pgmap v244: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:21.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:21 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3765997661' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:21.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:21 trial091 ceph-mon[25068]: pgmap v244: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:21.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:21 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3765997661' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:23.745 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:23.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:23 trial126 ceph-mon[26569]: pgmap v245: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:23.866 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:23.890 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:23 trial091 ceph-mon[25068]: pgmap v245: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:23.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:23 trial154 ceph-mon[27045]: pgmap v245: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3968764107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 msgr2=0x7f6d1810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3968764107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1810f5d0 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=3654007418253272302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d080099a0 tx=0x7f6d0802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3968764107 shutdown_connections 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3968764107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d18115410 0x7f6d18175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3968764107 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d1810fbf0 0x7f6d18114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3968764107 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1810f5d0 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=3654007418253272302 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3968764107 >> 10.20.193.91:0/3968764107 conn(0x7f6d180ecb00 msgr2=0x7f6d1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3968764107 shutdown_connections 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.991+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3968764107 wait complete. 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 Processor -- start 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 -- start start 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1811d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d18115410 0x7f6d1811d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d18122c90 0x7f6d18123130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181236a0 con 0x7f6d1810f200 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d18123810 con 0x7f6d18115410 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d181239d0 con 0x7f6d18122c90 2026-02-13T01:27:23.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1811d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1811d390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60354/0 (socket says 10.20.193.91:60354) 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 -- 10.20.193.91:0/3117584681 learned_addr learned my addr 10.20.193.91:0/3117584681 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1d11e6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d18122c90 0x7f6d18123130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d0ffff6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d18115410 0x7f6d1811d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 -- 10.20.193.91:0/3117584681 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d18122c90 msgr2=0x7f6d18123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d18122c90 0x7f6d18123130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 -- 10.20.193.91:0/3117584681 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d18115410 msgr2=0x7f6d1811d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d18115410 0x7f6d1811d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 -- 10.20.193.91:0/3117584681 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d08009590 con 0x7f6d1810f200 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1c91d6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1811d390 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0802f230 tx=0x7f6d0802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d08002ba0 con 0x7f6d1810f200 2026-02-13T01:27:23.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d18163e20 con 0x7f6d1810f200 2026-02-13T01:27:23.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6d08002d00 con 0x7f6d1810f200 2026-02-13T01:27:23.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d080372f0 con 0x7f6d1810f200 2026-02-13T01:27:23.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.992+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d18164250 con 0x7f6d1810f200 2026-02-13T01:27:23.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.993+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d181104d0 con 0x7f6d1810f200 2026-02-13T01:27:23.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.994+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6d080078d0 con 0x7f6d1810f200 2026-02-13T01:27:23.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.995+0000 7f6d0dffb6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6cf40b5650 0x7f6cf40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:23.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.995+0000 7f6d0ffff6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6cf40b5650 0x7f6cf40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:23.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.995+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f6d08107d60 con 0x7f6d1810f200 2026-02-13T01:27:23.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.995+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d080cd6d0 con 0x7f6d1810f200 2026-02-13T01:27:23.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:23.995+0000 7f6d0ffff6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6cf40b5650 0x7f6cf40d5b00 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d00005980 tx=0x7f6d00005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:24.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.113+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6d1810f5d0 con 0x7f6d1810f200 2026-02-13T01:27:24.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.114+0000 7f6d0dffb6c0 1 -- 10.20.193.91:0/3117584681 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6d080cd8b0 con 0x7f6d1810f200 2026-02-13T01:27:24.114 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:24.114 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:24.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6cf40b5650 msgr2=0x7f6cf40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6cf40b5650 0x7f6cf40d5b00 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d00005980 tx=0x7f6d00005910 comp rx=0 tx=0).stop 2026-02-13T01:27:24.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 msgr2=0x7f6d1811d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:24.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1811d390 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0802f230 tx=0x7f6d0802fd40 comp rx=0 tx=0).stop 2026-02-13T01:27:24.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 shutdown_connections 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6cf40b5650 0x7f6cf40d5b00 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d18122c90 0x7f6d18123130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d18115410 0x7f6d1811d8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 --2- 10.20.193.91:0/3117584681 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d1810f200 0x7f6d1811d390 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 >> 10.20.193.91:0/3117584681 conn(0x7f6d180ecb00 msgr2=0x7f6d1810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 shutdown_connections 2026-02-13T01:27:24.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:24.115+0000 7f6d1ebac6c0 1 -- 10.20.193.91:0/3117584681 wait complete. 2026-02-13T01:27:24.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:24 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3117584681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:24.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:24 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3117584681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:24.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:24 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3117584681' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:25.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:25 trial126 ceph-mon[26569]: pgmap v246: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T01:27:25.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:25 trial154 ceph-mon[27045]: pgmap v246: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T01:27:25.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:25 trial091 ceph-mon[25068]: pgmap v246: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T01:27:26.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:26 trial126 ceph-mon[26569]: pgmap v247: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:26.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:26 trial154 ceph-mon[27045]: pgmap v247: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:26.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:26 trial091 ceph-mon[25068]: pgmap v247: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:27.156 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:27.274 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:27.390 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/314509142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 msgr2=0x7ff1a4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/314509142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a4175db0 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=18231702750025201500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1a000aa70 tx=0x7ff1a002fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/314509142 shutdown_connections 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/314509142 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a4175db0 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=18231702750025201500 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/314509142 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410fbf0 0x7ff1a4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/314509142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff1a410f200 0x7ff1a410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/314509142 >> 10.20.193.91:0/314509142 conn(0x7ff1a40ecb00 msgr2=0x7ff1a410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/314509142 shutdown_connections 2026-02-13T01:27:27.391 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/314509142 wait complete. 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 Processor -- start 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.389+0000 7ff1aab0c6c0 1 -- start start 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410f200 0x7ff1a411d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a411d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff1a4122b50 0x7ff1a4122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4123560 con 0x7ff1a4115410 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41236d0 con 0x7ff1a4122b50 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4123890 con 0x7ff1a410f200 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a411d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a411d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60460/0 (socket says 10.20.193.91:60460) 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 -- 10.20.193.91:0/2234588858 learned_addr learned my addr 10.20.193.91:0/2234588858 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:27.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1a887d6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410f200 0x7ff1a411d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 -- 10.20.193.91:0/2234588858 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410f200 msgr2=0x7ff1a411d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410f200 0x7ff1a411d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 -- 10.20.193.91:0/2234588858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff1a4122b50 msgr2=0x7ff1a4122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff1a4122b50 0x7ff1a4122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 -- 10.20.193.91:0/2234588858 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a000a660 con 0x7ff1a4115410 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1a887d6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410f200 0x7ff1a411d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff19bfff6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a411d790 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff18c00b750 tx=0x7ff18c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff18c004a80 con 0x7ff1a4115410 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff18c009030 con 0x7ff1a4115410 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff18c00cd00 con 0x7ff1a4115410 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a4163d40 con 0x7ff1a4115410 2026-02-13T01:27:27.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41641d0 con 0x7ff1a4115410 2026-02-13T01:27:27.394 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.390+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a41104d0 con 0x7ff1a4115410 2026-02-13T01:27:27.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.392+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff18c005020 con 0x7ff1a4115410 2026-02-13T01:27:27.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.393+0000 7ff199ffb6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1800b5650 0x7ff1800d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:27.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.393+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff18c0e3c80 con 0x7ff1a4115410 2026-02-13T01:27:27.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.393+0000 7ff1a887d6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1800b5650 0x7ff1800d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:27.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.393+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff18c0a9630 con 0x7ff1a4115410 2026-02-13T01:27:27.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.393+0000 7ff1a887d6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1800b5650 0x7ff1800d5b00 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff194004750 tx=0x7ff194009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:27.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.508+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff1a411e400 con 0x7ff1a4115410 2026-02-13T01:27:27.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.508+0000 7ff199ffb6c0 1 -- 10.20.193.91:0/2234588858 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff18c0a9810 con 0x7ff1a4115410 2026-02-13T01:27:27.508 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:27.508 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:27.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1800b5650 msgr2=0x7ff1800d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:27.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1800b5650 0x7ff1800d5b00 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff194004750 tx=0x7ff194009260 comp rx=0 tx=0).stop 2026-02-13T01:27:27.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 msgr2=0x7ff1a411d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:27.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a411d790 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff18c00b750 tx=0x7ff18c00bc20 comp rx=0 tx=0).stop 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 shutdown_connections 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff1800b5650 0x7ff1800d5b00 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff1a4122b50 0x7ff1a4122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff1a4115410 0x7ff1a411d790 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 --2- 10.20.193.91:0/2234588858 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff1a410f200 0x7ff1a411d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 >> 10.20.193.91:0/2234588858 conn(0x7ff1a40ecb00 msgr2=0x7ff1a410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 shutdown_connections 2026-02-13T01:27:27.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:27.509+0000 7ff1aab0c6c0 1 -- 10.20.193.91:0/2234588858 wait complete. 2026-02-13T01:27:27.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2234588858' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:27.866 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2234588858' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:27.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2234588858' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:28.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:28 trial126 ceph-mon[26569]: pgmap v248: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:28.965 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:28 trial154 ceph-mon[27045]: pgmap v248: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:28.978 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:28 trial091 ceph-mon[25068]: pgmap v248: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:30.548 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:30.670 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/3700814162 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f392410fbf0 msgr2=0x7f3924114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/3700814162 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f392410fbf0 0x7f3924114c30 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=13539497172777775164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39180099a0 tx=0x7f391802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/3700814162 shutdown_connections 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/3700814162 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f3924115410 0x7f3924175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/3700814162 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f392410fbf0 0x7f3924114c30 unknown :-1 s=CLOSED pgs=377 gs=1 cs=0 l=1 c_cookie=13539497172777775164 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/3700814162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f392410f200 0x7f392410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/3700814162 >> 10.20.193.91:0/3700814162 conn(0x7f39240ecb00 msgr2=0x7f392410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:30.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/3700814162 shutdown_connections 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/3700814162 wait complete. 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 Processor -- start 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- start start 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f392410f200 0x7f39240f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 0x7f3924175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39240f5310 0x7f39240fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f39240f5a00 con 0x7f3924115410 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f39240fab20 con 0x7f39240f5310 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.784+0000 7f392c7cf6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39240face0 con 0x7f392410f200 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 0x7f3924175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:30.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 0x7f3924175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60470/0 (socket says 10.20.193.91:60470) 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 -- 10.20.193.91:0/2613722354 learned_addr learned my addr 10.20.193.91:0/2613722354 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f392a5406c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f392410f200 0x7f39240f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 -- 10.20.193.91:0/2613722354 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f392410f200 msgr2=0x7f39240f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f392410f200 0x7f39240f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 -- 10.20.193.91:0/2613722354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39240f5310 msgr2=0x7f39240fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39240f5310 0x7f39240fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 -- 10.20.193.91:0/2613722354 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3918009590 con 0x7f3924115410 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f392a5406c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f392410f200 0x7f39240f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f3929d3f6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 0x7f3924175cb0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3918004830 tx=0x7f391802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3918002ae0 con 0x7f3924115410 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3918002c40 con 0x7f3924115410 2026-02-13T01:27:30.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f39180362f0 con 0x7f3924115410 2026-02-13T01:27:30.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39240faf60 con 0x7f3924115410 2026-02-13T01:27:30.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39240fb400 con 0x7f3924115410 2026-02-13T01:27:30.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.785+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39241104d0 con 0x7f3924115410 2026-02-13T01:27:30.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.787+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f3918007810 con 0x7f3924115410 2026-02-13T01:27:30.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.787+0000 7f390b7fe6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39000b56d0 0x7f39000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:30.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.787+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f3918107ca0 con 0x7f3924115410 2026-02-13T01:27:30.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.787+0000 7f392a5406c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39000b56d0 0x7f39000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:30.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.788+0000 7f392a5406c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39000b56d0 0x7f39000d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3914004750 tx=0x7f3914005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:30.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.788+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f39180ca680 con 0x7f3924115410 2026-02-13T01:27:30.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.902+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f392410fbf0 con 0x7f3924115410 2026-02-13T01:27:30.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.902+0000 7f390b7fe6c0 1 -- 10.20.193.91:0/2613722354 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f39180cd830 con 0x7f3924115410 2026-02-13T01:27:30.902 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:30.902 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:30.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39000b56d0 msgr2=0x7f39000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39000b56d0 0x7f39000d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3914004750 tx=0x7f3914005f10 comp rx=0 tx=0).stop 2026-02-13T01:27:30.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 msgr2=0x7f3924175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:30.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 0x7f3924175cb0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3918004830 tx=0x7f391802fbf0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 shutdown_connections 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f39000b56d0 0x7f39000d5b80 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39240f5310 0x7f39240fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f3924115410 0x7f3924175cb0 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 --2- 10.20.193.91:0/2613722354 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f392410f200 0x7f39240f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 >> 10.20.193.91:0/2613722354 conn(0x7f39240ecb00 msgr2=0x7f392410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 shutdown_connections 2026-02-13T01:27:30.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:30.903+0000 7f392c7cf6c0 1 -- 10.20.193.91:0/2613722354 wait complete. 2026-02-13T01:27:31.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:31 trial154 ceph-mon[27045]: pgmap v249: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:31.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:31 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2613722354' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:31.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:31 trial091 ceph-mon[25068]: pgmap v249: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:31.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:31 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2613722354' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:31 trial126 ceph-mon[26569]: pgmap v249: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:31 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2613722354' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:33.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:33 trial154 ceph-mon[27045]: pgmap v250: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:33 trial091 ceph-mon[25068]: pgmap v250: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:33 trial126 ceph-mon[26569]: pgmap v250: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:33.944 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:34.063 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:34.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/866555385 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff810fbf0 msgr2=0x7f7ff8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/866555385 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff810fbf0 0x7f7ff8114c30 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=10872342693819587187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fe00099a0 tx=0x7f7fe002ed50 comp rx=0 tx=0).stop 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/866555385 shutdown_connections 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/866555385 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff8115410 0x7f7ff8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/866555385 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff810fbf0 0x7f7ff8114c30 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=10872342693819587187 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/866555385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7ff810f200 0x7f7ff810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/866555385 >> 10.20.193.91:0/866555385 conn(0x7f7ff80ecb00 msgr2=0x7f7ff810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/866555385 shutdown_connections 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/866555385 wait complete. 2026-02-13T01:27:34.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 Processor -- start 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- start start 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff810f200 0x7f7ff80f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 0x7f7ff8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7ff80f52c0 0x7f7ff80fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff80f5920 con 0x7f7ff8115410 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff80faad0 con 0x7f7ff80f52c0 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ffd8a56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff80fac90 con 0x7f7ff810f200 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 0x7f7ff8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 0x7f7ff8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60496/0 (socket says 10.20.193.91:60496) 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 -- 10.20.193.91:0/701610486 learned_addr learned my addr 10.20.193.91:0/701610486 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 -- 10.20.193.91:0/701610486 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff810f200 msgr2=0x7f7ff80f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff6ffd6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff810f200 0x7f7ff80f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff810f200 0x7f7ff80f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 -- 10.20.193.91:0/701610486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7ff80f52c0 msgr2=0x7f7ff80fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7ff80f52c0 0x7f7ff80fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff67fc6c0 1 -- 10.20.193.91:0/701610486 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe0009590 con 0x7f7ff8115410 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.176+0000 7f7ff6ffd6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff810f200 0x7f7ff80f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ff67fc6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 0x7f7ff8175cb0 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fe00023a0 tx=0x7f7fe002fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7fe0002ae0 con 0x7f7ff8115410 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7fe0002c40 con 0x7f7ff8115410 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7fe00372f0 con 0x7f7ff8115410 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff80faeb0 con 0x7f7ff8115410 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff80fb380 con 0x7f7ff8115410 2026-02-13T01:27:34.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.177+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff81104d0 con 0x7f7ff8115410 2026-02-13T01:27:34.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.178+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7fe00071c0 con 0x7f7ff8115410 2026-02-13T01:27:34.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.179+0000 7f7ffc89f6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7fcc0b56d0 0x7f7fcc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:34.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.179+0000 7f7ff6ffd6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7fcc0b56d0 0x7f7fcc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:34.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.179+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7fe0107ea0 con 0x7f7ff8115410 2026-02-13T01:27:34.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.179+0000 7f7ff6ffd6c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7fcc0b56d0 0x7f7fcc0d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fec004750 tx=0x7f7fec005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:34.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.180+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7fe00ca840 con 0x7f7ff8115410 2026-02-13T01:27:34.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.297+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ff810f5d0 con 0x7f7ff8115410 2026-02-13T01:27:34.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.297+0000 7f7ffc89f6c0 1 -- 10.20.193.91:0/701610486 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7fe00cd9f0 con 0x7f7ff8115410 2026-02-13T01:27:34.297 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:34.297 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:34.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7fcc0b56d0 msgr2=0x7f7fcc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7fcc0b56d0 0x7f7fcc0d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fec004750 tx=0x7f7fec005f10 comp rx=0 tx=0).stop 2026-02-13T01:27:34.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 msgr2=0x7f7ff8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:34.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 0x7f7ff8175cb0 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7fe00023a0 tx=0x7f7fe002fbe0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 shutdown_connections 2026-02-13T01:27:34.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7fcc0b56d0 0x7f7fcc0d5b80 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7ff80f52c0 0x7f7ff80fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7ff8115410 0x7f7ff8175cb0 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 --2- 10.20.193.91:0/701610486 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7ff810f200 0x7f7ff80f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:34.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 >> 10.20.193.91:0/701610486 conn(0x7f7ff80ecb00 msgr2=0x7f7ff8111bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:34.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 shutdown_connections 2026-02-13T01:27:34.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:34.298+0000 7f7ffd8a56c0 1 -- 10.20.193.91:0/701610486 wait complete. 2026-02-13T01:27:35.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:35 trial154 ceph-mon[27045]: pgmap v251: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:35.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:35 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/701610486' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:35 trial091 ceph-mon[25068]: pgmap v251: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:35.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:35 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/701610486' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:35.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:35 trial126 ceph-mon[26569]: pgmap v251: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:35.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:35 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/701610486' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:37.340 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:37.458 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:37.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:37 trial154 ceph-mon[27045]: pgmap v252: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:37.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:37 trial091 ceph-mon[25068]: pgmap v252: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1960990457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c10cf90 msgr2=0x7f1b1c10d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1960990457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c10cf90 0x7f1b1c10d360 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=1272120426922717223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0c0099a0 tx=0x7f1b0c02ed00 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1960990457 shutdown_connections 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1960990457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1c1131a0 0x7f1b1c173b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1960990457 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b1c10d980 0x7f1b1c1129c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1960990457 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c10cf90 0x7f1b1c10d360 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=1272120426922717223 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1960990457 >> 10.20.193.91:0/1960990457 conn(0x7f1b1c0ea8b0 msgr2=0x7f1b1c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1960990457 shutdown_connections 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.581+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1960990457 wait complete. 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 Processor -- start 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 -- start start 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1c10cf90 0x7f1b1c0f4ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b1c1131a0 0x7f1b1c173a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 0x7f1b1c0fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c0f59c0 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c0faae0 con 0x7f1b1c10cf90 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c0faca0 con 0x7f1b1c1131a0 2026-02-13T01:27:37.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 0x7f1b1c0fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 0x7f1b1c0fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:38626/0 (socket says 10.20.193.91:38626) 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 -- 10.20.193.91:0/1083182039 learned_addr learned my addr 10.20.193.91:0/1083182039 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b13fff6c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b1c1131a0 0x7f1b1c173a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b209796c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1c10cf90 0x7f1b1c0f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 -- 10.20.193.91:0/1083182039 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b1c1131a0 msgr2=0x7f1b1c173a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b1c1131a0 0x7f1b1c173a40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 -- 10.20.193.91:0/1083182039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1c10cf90 msgr2=0x7f1b1c0f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1c10cf90 0x7f1b1c0f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 -- 10.20.193.91:0/1083182039 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c009590 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b2117a6c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 0x7f1b1c0fa5a0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b18006a60 tx=0x7f1b1800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:37.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b18003c40 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1b1800a070 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1c0faf80 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b1800dde0 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.582+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b1c0fb710 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.583+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b1c10e260 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.584+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1b18005030 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.585+0000 7f1b11ffb6c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1af80b56d0 0x7f1af80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.585+0000 7f1b209796c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1af80b56d0 0x7f1af80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.585+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f1b180e4ac0 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.585+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1b180aa610 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.585+0000 7f1b209796c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1af80b56d0 0x7f1af80d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0c0023e0 tx=0x7f1b0c031f90 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:37.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:37 trial126 ceph-mon[26569]: pgmap v252: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:37.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.701+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b1c0f5df0 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.701+0000 7f1b11ffb6c0 1 -- 10.20.193.91:0/1083182039 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1b180aa7f0 con 0x7f1b1c0f52d0 2026-02-13T01:27:37.702 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:37.702 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:37.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1af80b56d0 msgr2=0x7f1af80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1af80b56d0 0x7f1af80d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b0c0023e0 tx=0x7f1b0c031f90 comp rx=0 tx=0).stop 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 msgr2=0x7f1b1c0fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 0x7f1b1c0fa5a0 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b18006a60 tx=0x7f1b1800cca0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 shutdown_connections 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1af80b56d0 0x7f1af80d5b80 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b1c0f52d0 0x7f1b1c0fa5a0 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b1c1131a0 0x7f1b1c173a40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 --2- 10.20.193.91:0/1083182039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b1c10cf90 0x7f1b1c0f4ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 >> 10.20.193.91:0/1083182039 conn(0x7f1b1c0ea8b0 msgr2=0x7f1b1c10b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 shutdown_connections 2026-02-13T01:27:37.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:37.702+0000 7f1b22c046c0 1 -- 10.20.193.91:0/1083182039 wait complete. 2026-02-13T01:27:38.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:38 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1083182039' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:38.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:38 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1083182039' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:38.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:38 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1083182039' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:39.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:39 trial154 ceph-mon[27045]: pgmap v253: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:39.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:39 trial091 ceph-mon[25068]: pgmap v253: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:39 trial126 ceph-mon[26569]: pgmap v253: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:40.744 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:40.867 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:40.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- 10.20.193.91:0/4264010803 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a8115410 msgr2=0x7f45a8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:40.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/4264010803 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a8115410 0x7f45a8175db0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=10704814798333013342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f459800aa70 tx=0x7f459802fde0 comp rx=0 tx=0).stop 2026-02-13T01:27:40.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- 10.20.193.91:0/4264010803 shutdown_connections 2026-02-13T01:27:40.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/4264010803 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a8115410 0x7f45a8175db0 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=10704814798333013342 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/4264010803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a810fbf0 0x7f45a8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/4264010803 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45a810f200 0x7f45a810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- 10.20.193.91:0/4264010803 >> 10.20.193.91:0/4264010803 conn(0x7f45a80ecb00 msgr2=0x7f45a810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- 10.20.193.91:0/4264010803 shutdown_connections 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- 10.20.193.91:0/4264010803 wait complete. 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 Processor -- start 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- start start 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 0x7f45a811d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45a8115410 0x7f45a811d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a8122ad0 0x7f45a8122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f45a81234e0 con 0x7f45a810f200 2026-02-13T01:27:40.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8123650 con 0x7f45a8122ad0 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45ad5406c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45a8123810 con 0x7f45a8115410 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 0x7f45a811d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 0x7f45a811d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:38640/0 (socket says 10.20.193.91:38640) 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 -- 10.20.193.91:0/2957302712 learned_addr learned my addr 10.20.193.91:0/2957302712 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a67fc6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45a8115410 0x7f45a811d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a77fe6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a8122ad0 0x7f45a8122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 -- 10.20.193.91:0/2957302712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45a8115410 msgr2=0x7f45a811d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45a8115410 0x7f45a811d710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 -- 10.20.193.91:0/2957302712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a8122ad0 msgr2=0x7f45a8122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a8122ad0 0x7f45a8122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a6ffd6c0 1 -- 10.20.193.91:0/2957302712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459800a660 con 0x7f45a810f200 2026-02-13T01:27:40.984 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.980+0000 7f45a77fe6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a8122ad0 0x7f45a8122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f45a6ffd6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 0x7f45a811d1d0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f459c005dc0 tx=0x7f459c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f459c004250 con 0x7f45a810f200 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f459c009070 con 0x7f45a810f200 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a8163cc0 con 0x7f45a810f200 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f459c00cd70 con 0x7f45a810f200 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a8164150 con 0x7f45a810f200 2026-02-13T01:27:40.985 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.981+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a81104d0 con 0x7f45a810f200 2026-02-13T01:27:40.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.983+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f459c0028c0 con 0x7f45a810f200 2026-02-13T01:27:40.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.983+0000 7f4587fff6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f457c0b56d0 0x7f457c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:40.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.983+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f459c0e3bd0 con 0x7f45a810f200 2026-02-13T01:27:40.986 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.983+0000 7f45a67fc6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f457c0b56d0 0x7f457c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:40.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.983+0000 7f45a67fc6c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f457c0b56d0 0x7f457c0d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4590005fd0 tx=0x7f4590005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:40.987 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:40.984+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f459c0a6570 con 0x7f45a810f200 2026-02-13T01:27:41.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.103+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f45a810fbf0 con 0x7f45a810f200 2026-02-13T01:27:41.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.103+0000 7f4587fff6c0 1 -- 10.20.193.91:0/2957302712 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f459c0a9720 con 0x7f45a810f200 2026-02-13T01:27:41.104 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:41.104 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:41.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f457c0b56d0 msgr2=0x7f457c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f457c0b56d0 0x7f457c0d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4590005fd0 tx=0x7f4590005910 comp rx=0 tx=0).stop 2026-02-13T01:27:41.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 msgr2=0x7f45a811d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:41.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 0x7f45a811d1d0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f459c005dc0 tx=0x7f459c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 shutdown_connections 2026-02-13T01:27:41.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f457c0b56d0 0x7f457c0d5b80 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45a8122ad0 0x7f45a8122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f45a8115410 0x7f45a811d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 --2- 10.20.193.91:0/2957302712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f45a810f200 0x7f45a811d1d0 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:41.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.104+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 >> 10.20.193.91:0/2957302712 conn(0x7f45a80ecb00 msgr2=0x7f45a810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:41.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.105+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 shutdown_connections 2026-02-13T01:27:41.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:41.105+0000 7f45ad5406c0 1 -- 10.20.193.91:0/2957302712 wait complete. 2026-02-13T01:27:41.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:41 trial154 ceph-mon[27045]: pgmap v254: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:41.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:41 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2957302712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:41.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:41 trial091 ceph-mon[25068]: pgmap v254: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:41.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:41 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2957302712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:41.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:41 trial126 ceph-mon[26569]: pgmap v254: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:41.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:41 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2957302712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:43.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:43 trial154 ceph-mon[27045]: pgmap v255: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:43.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:43 trial091 ceph-mon[25068]: pgmap v255: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:43.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:43 trial126 ceph-mon[26569]: pgmap v255: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:44.146 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:44.266 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:44.384 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- 10.20.193.91:0/1825027196 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 msgr2=0x7ff8e810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/1825027196 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e810f5d0 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=17981782389705962556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8d80099a0 tx=0x7ff8d802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- 10.20.193.91:0/1825027196 shutdown_connections 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/1825027196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e8115410 0x7ff8e8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/1825027196 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8e810fbf0 0x7ff8e8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/1825027196 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e810f5d0 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=17981782389705962556 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- 10.20.193.91:0/1825027196 >> 10.20.193.91:0/1825027196 conn(0x7ff8e80ecb00 msgr2=0x7ff8e810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- 10.20.193.91:0/1825027196 shutdown_connections 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- 10.20.193.91:0/1825027196 wait complete. 2026-02-13T01:27:44.385 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 Processor -- start 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- start start 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e811d2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e8115410 0x7ff8e811d820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8e8122be0 0x7ff8e8123080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e81235c0 con 0x7ff8e810f200 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8123730 con 0x7ff8e8115410 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8efc336c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e81238f0 con 0x7ff8e8122be0 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e811d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e811d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:38664/0 (socket says 10.20.193.91:38664) 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 -- 10.20.193.91:0/4111671253 learned_addr learned my addr 10.20.193.91:0/4111671253 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ee1a56c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8e8122be0 0x7ff8e8123080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.386 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 -- 10.20.193.91:0/4111671253 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8e8122be0 msgr2=0x7ff8e8123080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8e8122be0 0x7ff8e8123080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 -- 10.20.193.91:0/4111671253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e8115410 msgr2=0x7ff8e811d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e8115410 0x7ff8e811d820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.382+0000 7ff8ed9a46c0 1 -- 10.20.193.91:0/4111671253 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d8009590 con 0x7ff8e810f200 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8ed9a46c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e811d2e0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8d802f230 tx=0x7ff8d802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8d8002ba0 con 0x7ff8e810f200 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff8d8002d00 con 0x7ff8e810f200 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8d80372f0 con 0x7ff8e810f200 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e8163d70 con 0x7ff8e810f200 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81641a0 con 0x7ff8e810f200 2026-02-13T01:27:44.387 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.383+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e81104d0 con 0x7ff8e810f200 2026-02-13T01:27:44.388 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.385+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff8d80078d0 con 0x7ff8e810f200 2026-02-13T01:27:44.389 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.385+0000 7ff8d6ffd6c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8c40b56d0 0x7ff8c40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:44.389 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.386+0000 7ff8ed1a36c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8c40b56d0 0x7ff8c40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:44.389 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.386+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff8d8107c20 con 0x7ff8e810f200 2026-02-13T01:27:44.389 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.386+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8d80cd7b0 con 0x7ff8e810f200 2026-02-13T01:27:44.389 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.386+0000 7ff8ed1a36c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8c40b56d0 0x7ff8c40d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e8123c70 tx=0x7ff8dc005d30 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:44.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.499+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8e811e430 con 0x7ff8e810f200 2026-02-13T01:27:44.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.499+0000 7ff8d6ffd6c0 1 -- 10.20.193.91:0/4111671253 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8d80cd990 con 0x7ff8e810f200 2026-02-13T01:27:44.500 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:44.500 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8c40b56d0 msgr2=0x7ff8c40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8c40b56d0 0x7ff8c40d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8e8123c70 tx=0x7ff8dc005d30 comp rx=0 tx=0).stop 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 msgr2=0x7ff8e811d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e811d2e0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8d802f230 tx=0x7ff8d802fd40 comp rx=0 tx=0).stop 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 shutdown_connections 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff8c40b56d0 0x7ff8c40d5b80 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff8e8122be0 0x7ff8e8123080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e8115410 0x7ff8e811d820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 --2- 10.20.193.91:0/4111671253 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff8e810f200 0x7ff8e811d2e0 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:44.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 >> 10.20.193.91:0/4111671253 conn(0x7ff8e80ecb00 msgr2=0x7ff8e810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:44.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 shutdown_connections 2026-02-13T01:27:44.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:44.500+0000 7ff8efc336c0 1 -- 10.20.193.91:0/4111671253 wait complete. 2026-02-13T01:27:45.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:45 trial154 ceph-mon[27045]: pgmap v256: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:45.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:45 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4111671253' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:45.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:45 trial091 ceph-mon[25068]: pgmap v256: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:45.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:45 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4111671253' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:45.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:45 trial126 ceph-mon[26569]: pgmap v256: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:45.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:45 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4111671253' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:47.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:47 trial154 ceph-mon[27045]: pgmap v257: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:47.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:47 trial091 ceph-mon[25068]: pgmap v257: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:47.545 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:47.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:47 trial126 ceph-mon[26569]: pgmap v257: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:47.663 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/1061760665 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff810fbf0 msgr2=0x7f8ff8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/1061760665 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff810fbf0 0x7f8ff8114c30 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=5048050407419668564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec0099a0 tx=0x7f8fec02ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/1061760665 shutdown_connections 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/1061760665 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8ff8115410 0x7f8ff8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/1061760665 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff810fbf0 0x7f8ff8114c30 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=5048050407419668564 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/1061760665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ff810f200 0x7f8ff810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/1061760665 >> 10.20.193.91:0/1061760665 conn(0x7f8ff80ecb00 msgr2=0x7f8ff810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/1061760665 shutdown_connections 2026-02-13T01:27:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/1061760665 wait complete. 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 Processor -- start 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.774+0000 7f8ffff3b6c0 1 -- start start 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8ff810f200 0x7f8ff80f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 0x7f8ff8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ff80f5310 0x7f8ff80fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80f5a00 con 0x7f8ff8115410 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80fab20 con 0x7f8ff80f5310 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff80face0 con 0x7f8ff810f200 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 0x7f8ff8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 0x7f8ff8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:53430/0 (socket says 10.20.193.91:53430) 2026-02-13T01:27:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 -- 10.20.193.91:0/3325310896 learned_addr learned my addr 10.20.193.91:0/3325310896 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffdcac6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8ff810f200 0x7f8ff80f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffe4ad6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ff80f5310 0x7f8ff80fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 -- 10.20.193.91:0/3325310896 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8ff810f200 msgr2=0x7f8ff80f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8ff810f200 0x7f8ff80f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 -- 10.20.193.91:0/3325310896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ff80f5310 msgr2=0x7f8ff80fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ff80f5310 0x7f8ff80fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 -- 10.20.193.91:0/3325310896 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec009590 con 0x7f8ff8115410 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffd4ab6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 0x7f8ff8175cb0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec02f230 tx=0x7f8fec02fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fec002ae0 con 0x7f8ff8115410 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8fec002c40 con 0x7f8ff8115410 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff80faf60 con 0x7f8ff8115410 2026-02-13T01:27:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fec037070 con 0x7f8ff8115410 2026-02-13T01:27:47.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.775+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff80fb430 con 0x7f8ff8115410 2026-02-13T01:27:47.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.776+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff81104d0 con 0x7f8ff8115410 2026-02-13T01:27:47.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.777+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8fec007780 con 0x7f8ff8115410 2026-02-13T01:27:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.778+0000 7f8fe6ffd6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8fd40b56d0 0x7f8fd40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.778+0000 7f8ffdcac6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8fd40b56d0 0x7f8fd40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.778+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f8fec107a80 con 0x7f8ff8115410 2026-02-13T01:27:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.778+0000 7f8ffdcac6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8fd40b56d0 0x7f8fd40d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe8004750 tx=0x7f8fe8009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.778+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8fec1405e0 con 0x7f8ff8115410 2026-02-13T01:27:47.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.893+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ff80f5e30 con 0x7f8ff8115410 2026-02-13T01:27:47.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.893+0000 7f8fe6ffd6c0 1 -- 10.20.193.91:0/3325310896 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8fec0ca460 con 0x7f8ff8115410 2026-02-13T01:27:47.894 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:47.894 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8fd40b56d0 msgr2=0x7f8fd40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8fd40b56d0 0x7f8fd40d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fe8004750 tx=0x7f8fe8009260 comp rx=0 tx=0).stop 2026-02-13T01:27:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 msgr2=0x7f8ff8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 0x7f8ff8175cb0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fec02f230 tx=0x7f8fec02fb80 comp rx=0 tx=0).stop 2026-02-13T01:27:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 shutdown_connections 2026-02-13T01:27:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8fd40b56d0 0x7f8fd40d5b80 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ff80f5310 0x7f8ff80fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8ff8115410 0x7f8ff8175cb0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 --2- 10.20.193.91:0/3325310896 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8ff810f200 0x7f8ff80f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 >> 10.20.193.91:0/3325310896 conn(0x7f8ff80ecb00 msgr2=0x7f8ff810d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 shutdown_connections 2026-02-13T01:27:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:47.894+0000 7f8ffff3b6c0 1 -- 10.20.193.91:0/3325310896 wait complete. 2026-02-13T01:27:48.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:48 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3325310896' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:48.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:48 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3325310896' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:48.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:48 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3325310896' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:49.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:49 trial154 ceph-mon[27045]: pgmap v258: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:49 trial091 ceph-mon[25068]: pgmap v258: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:49 trial126 ceph-mon[26569]: pgmap v258: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:50.935 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:51.054 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:51.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- 10.20.193.91:0/2373585607 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f816410fbf0 msgr2=0x7f8164114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:51.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- 10.20.193.91:0/2373585607 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f816410fbf0 0x7f8164114c30 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=16019268944172464186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81580099a0 tx=0x7f815802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:51.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- 10.20.193.91:0/2373585607 shutdown_connections 2026-02-13T01:27:51.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- 10.20.193.91:0/2373585607 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8164115410 0x7f8164175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- 10.20.193.91:0/2373585607 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f816410fbf0 0x7f8164114c30 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=16019268944172464186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- 10.20.193.91:0/2373585607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f816410f200 0x7f816410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- 10.20.193.91:0/2373585607 >> 10.20.193.91:0/2373585607 conn(0x7f81640ecb00 msgr2=0x7f816410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- 10.20.193.91:0/2373585607 shutdown_connections 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- 10.20.193.91:0/2373585607 wait complete. 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 Processor -- start 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- start start 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f816410f200 0x7f81640f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 0x7f8164175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f81640f52c0 0x7f81640fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:51.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f81640f59b0 con 0x7f8164115410 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f81640faad0 con 0x7f816410f200 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816c6696c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81640fac90 con 0x7f81640f52c0 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 0x7f8164175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 0x7f8164175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:53452/0 (socket says 10.20.193.91:53452) 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 -- 10.20.193.91:0/97691746 learned_addr learned my addr 10.20.193.91:0/97691746 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f816a3da6c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f816410f200 0x7f81640f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 -- 10.20.193.91:0/97691746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f81640f52c0 msgr2=0x7f81640fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f81640f52c0 0x7f81640fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 -- 10.20.193.91:0/97691746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f816410f200 msgr2=0x7f81640f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f816410f200 0x7f81640f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.166+0000 7f8169bd96c0 1 -- 10.20.193.91:0/97691746 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8158009590 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f8169bd96c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 0x7f8164175cb0 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815802f230 tx=0x7f815802fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8158002ae0 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8158002c40 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81640faf10 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8158037070 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81640fb390 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.167+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81641104d0 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.168+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8158007710 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.169+0000 7f814b7fe6c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81400b5650 0x7f81400d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.169+0000 7f816a3da6c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81400b5650 0x7f81400d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.169+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f8158107c20 con 0x7f8164115410 2026-02-13T01:27:51.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.170+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8158140680 con 0x7f8164115410 2026-02-13T01:27:51.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.170+0000 7f816a3da6c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81400b5650 0x7f81400d5b00 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8154004750 tx=0x7f8154009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:51.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.287+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f816410f5d0 con 0x7f8164115410 2026-02-13T01:27:51.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.287+0000 7f814b7fe6c0 1 -- 10.20.193.91:0/97691746 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f81580ca5c0 con 0x7f8164115410 2026-02-13T01:27:51.288 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:51.289 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:51.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81400b5650 msgr2=0x7f81400d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81400b5650 0x7f81400d5b00 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8154004750 tx=0x7f8154009260 comp rx=0 tx=0).stop 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 msgr2=0x7f8164175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 0x7f8164175cb0 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815802f230 tx=0x7f815802fb80 comp rx=0 tx=0).stop 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 shutdown_connections 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f81400b5650 0x7f81400d5b00 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f81640f52c0 0x7f81640fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8164115410 0x7f8164175cb0 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 --2- 10.20.193.91:0/97691746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f816410f200 0x7f81640f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 >> 10.20.193.91:0/97691746 conn(0x7f81640ecb00 msgr2=0x7f8164113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:51.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 shutdown_connections 2026-02-13T01:27:51.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:51.288+0000 7f816c6696c0 1 -- 10.20.193.91:0/97691746 wait complete. 2026-02-13T01:27:51.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:51 trial091 ceph-mon[25068]: pgmap v259: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:51 trial126 ceph-mon[26569]: pgmap v259: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:51.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:51 trial154 ceph-mon[27045]: pgmap v259: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:52.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:52 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/97691746' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:52 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/97691746' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:52.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:52 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/97691746' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:53.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:53 trial091 ceph-mon[25068]: pgmap v260: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:53 trial126 ceph-mon[26569]: pgmap v260: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:53.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:53 trial154 ceph-mon[27045]: pgmap v260: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:54.330 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:54.452 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- 10.20.193.91:0/1325062323 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f418010f230 msgr2=0x7f418010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- 10.20.193.91:0/1325062323 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f418010f230 0x7f418010f600 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=10912403243170029816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41700099a0 tx=0x7f417002ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- 10.20.193.91:0/1325062323 shutdown_connections 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- 10.20.193.91:0/1325062323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4180115440 0x7f4180175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- 10.20.193.91:0/1325062323 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f418010fc20 0x7f4180114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- 10.20.193.91:0/1325062323 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f418010f230 0x7f418010f600 unknown :-1 s=CLOSED pgs=391 gs=1 cs=0 l=1 c_cookie=10912403243170029816 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- 10.20.193.91:0/1325062323 >> 10.20.193.91:0/1325062323 conn(0x7f41800ecb30 msgr2=0x7f418010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- 10.20.193.91:0/1325062323 shutdown_connections 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- 10.20.193.91:0/1325062323 wait complete. 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 Processor -- start 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- start start 2026-02-13T01:27:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f418010f230 0x7f418011d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 0x7f418011d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4180122c20 0x7f41801230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4180123630 con 0x7f4180115440 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f41801237a0 con 0x7f4180122c20 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f41885706c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4180123960 con 0x7f418010f230 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f4185ae46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 0x7f418011d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f4185ae46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 0x7f418011d860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:53480/0 (socket says 10.20.193.91:53480) 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.563+0000 7f4185ae46c0 1 -- 10.20.193.91:0/2645910791 learned_addr learned my addr 10.20.193.91:0/2645910791 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4186ae66c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4180122c20 0x7f41801230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41862e56c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f418010f230 0x7f418011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:54.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4185ae46c0 1 -- 10.20.193.91:0/2645910791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f418010f230 msgr2=0x7f418011d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4185ae46c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f418010f230 0x7f418011d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4185ae46c0 1 -- 10.20.193.91:0/2645910791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4180122c20 msgr2=0x7f41801230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4185ae46c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4180122c20 0x7f41801230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4185ae46c0 1 -- 10.20.193.91:0/2645910791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4170009590 con 0x7f4180115440 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f4185ae46c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 0x7f418011d860 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f417400b6c0 tx=0x7f417400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4174004250 con 0x7f4180115440 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4180163e10 con 0x7f4180115440 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4174009070 con 0x7f4180115440 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f417400ccb0 con 0x7f4180115440 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41801642a0 con 0x7f4180115440 2026-02-13T01:27:54.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.564+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4180110500 con 0x7f4180115440 2026-02-13T01:27:54.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.566+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f41740028c0 con 0x7f4180115440 2026-02-13T01:27:54.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.566+0000 7f41677fe6c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f415c0b5650 0x7f415c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:54.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.566+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f41740e3c90 con 0x7f4180115440 2026-02-13T01:27:54.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.566+0000 7f41862e56c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f415c0b5650 0x7f415c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:54.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.567+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f41740a6630 con 0x7f4180115440 2026-02-13T01:27:54.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.567+0000 7f41862e56c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f415c0b5650 0x7f415c0d5b00 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41700092e0 tx=0x7f4170005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:54.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.682+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f418010f600 con 0x7f4180115440 2026-02-13T01:27:54.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.682+0000 7f41677fe6c0 1 -- 10.20.193.91:0/2645910791 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f41740a97e0 con 0x7f4180115440 2026-02-13T01:27:54.683 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:54.683 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:54.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f415c0b5650 msgr2=0x7f415c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:54.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f415c0b5650 0x7f415c0d5b00 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41700092e0 tx=0x7f4170005c00 comp rx=0 tx=0).stop 2026-02-13T01:27:54.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 msgr2=0x7f418011d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:54.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 0x7f418011d860 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f417400b6c0 tx=0x7f417400bb90 comp rx=0 tx=0).stop 2026-02-13T01:27:54.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 shutdown_connections 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f415c0b5650 0x7f415c0d5b00 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4180122c20 0x7f41801230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4180115440 0x7f418011d860 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 --2- 10.20.193.91:0/2645910791 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f418010f230 0x7f418011d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 >> 10.20.193.91:0/2645910791 conn(0x7f41800ecb30 msgr2=0x7f418010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 shutdown_connections 2026-02-13T01:27:54.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:54.683+0000 7f41885706c0 1 -- 10.20.193.91:0/2645910791 wait complete. 2026-02-13T01:27:55.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:55 trial091 ceph-mon[25068]: pgmap v261: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:55.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:55 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2645910791' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:55.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:55 trial126 ceph-mon[26569]: pgmap v261: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:55.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:55 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2645910791' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:55.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:55 trial154 ceph-mon[27045]: pgmap v261: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:27:55.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:55 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2645910791' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:57.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:57 trial091 ceph-mon[25068]: pgmap v262: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:57.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:57 trial154 ceph-mon[27045]: pgmap v262: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:57.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:57 trial126 ceph-mon[26569]: pgmap v262: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:27:57.725 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:27:57.844 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:27:57.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- 10.20.193.91:0/619223741 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a010f230 msgr2=0x7f20a010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/619223741 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a010f230 0x7f20a010f600 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=10023223529374419886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20980099a0 tx=0x7f209802ed20 comp rx=0 tx=0).stop 2026-02-13T01:27:57.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- 10.20.193.91:0/619223741 shutdown_connections 2026-02-13T01:27:57.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/619223741 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a0115440 0x7f20a0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/619223741 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f20a010fc20 0x7f20a0114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/619223741 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a010f230 0x7f20a010f600 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=10023223529374419886 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- 10.20.193.91:0/619223741 >> 10.20.193.91:0/619223741 conn(0x7f20a00ecb30 msgr2=0x7f20a010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- 10.20.193.91:0/619223741 shutdown_connections 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- 10.20.193.91:0/619223741 wait complete. 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 Processor -- start 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- start start 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a010f230 0x7f20a011d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f20a0115440 0x7f20a011d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 0x7f20a01230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0123630 con 0x7f20a0122c20 2026-02-13T01:27:57.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01237a0 con 0x7f20a010f230 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a89df6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0123960 con 0x7f20a0115440 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a6f516c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 0x7f20a01230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a6f516c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 0x7f20a01230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:58246/0 (socket says 10.20.193.91:58246) 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a6f516c0 1 -- 10.20.193.91:0/1183461483 learned_addr learned my addr 10.20.193.91:0/1183461483 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.961+0000 7f20a67506c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a010f230 0x7f20a011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a5f4f6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f20a0115440 0x7f20a011d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a6f516c0 1 -- 10.20.193.91:0/1183461483 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f20a0115440 msgr2=0x7f20a011d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a6f516c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f20a0115440 0x7f20a011d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a6f516c0 1 -- 10.20.193.91:0/1183461483 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a010f230 msgr2=0x7f20a011d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a6f516c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a010f230 0x7f20a011d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a6f516c0 1 -- 10.20.193.91:0/1183461483 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2098009590 con 0x7f20a0122c20 2026-02-13T01:27:57.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a67506c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a010f230 0x7f20a011d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a6f516c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 0x7f20a01230c0 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2094006ea0 tx=0x7f209400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2094003a30 con 0x7f20a0122c20 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f20940054f0 con 0x7f20a0122c20 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f209400dcd0 con 0x7f20a0122c20 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a0163e10 con 0x7f20a0122c20 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a01642f0 con 0x7f20a0122c20 2026-02-13T01:27:57.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.962+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a0110500 con 0x7f20a0122c20 2026-02-13T01:27:57.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.964+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2094005030 con 0x7f20a0122c20 2026-02-13T01:27:57.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.964+0000 7f208b7fe6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f207c0b56d0 0x7f207c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:27:57.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.965+0000 7f20a67506c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f207c0b56d0 0x7f207c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:27:57.968 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.965+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f20940e4c90 con 0x7f20a0122c20 2026-02-13T01:27:57.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.965+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f20940ab090 con 0x7f20a0122c20 2026-02-13T01:27:57.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:57.965+0000 7f20a67506c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f207c0b56d0 0x7f207c0d5b80 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2098005b40 tx=0x7f2098005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:27:58.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.080+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f20a010f600 con 0x7f20a0122c20 2026-02-13T01:27:58.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.080+0000 7f208b7fe6c0 1 -- 10.20.193.91:0/1183461483 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f20940ad100 con 0x7f20a0122c20 2026-02-13T01:27:58.081 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:27:58.082 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f207c0b56d0 msgr2=0x7f207c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f207c0b56d0 0x7f207c0d5b80 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2098005b40 tx=0x7f2098005c00 comp rx=0 tx=0).stop 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 msgr2=0x7f20a01230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 0x7f20a01230c0 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2094006ea0 tx=0x7f209400cca0 comp rx=0 tx=0).stop 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 shutdown_connections 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f207c0b56d0 0x7f207c0d5b80 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f20a0122c20 0x7f20a01230c0 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f20a0115440 0x7f20a011d860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 --2- 10.20.193.91:0/1183461483 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20a010f230 0x7f20a011d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:27:58.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 >> 10.20.193.91:0/1183461483 conn(0x7f20a00ecb30 msgr2=0x7f20a010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:27:58.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 shutdown_connections 2026-02-13T01:27:58.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:27:58.081+0000 7f20a89df6c0 1 -- 10.20.193.91:0/1183461483 wait complete. 2026-02-13T01:27:58.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:58 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1183461483' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:58.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:58 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1183461483' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:58.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:58 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1183461483' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:27:59.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:27:59 trial091 ceph-mon[25068]: pgmap v263: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:27:59 trial126 ceph-mon[26569]: pgmap v263: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:27:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:27:59 trial154 ceph-mon[27045]: pgmap v263: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:01.123 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:01.240 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:01.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1680795127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810fc20 msgr2=0x7f2978114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:01.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1680795127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810fc20 0x7f2978114c60 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=15934718305809430035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29680099a0 tx=0x7f296802ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:01.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1680795127 shutdown_connections 2026-02-13T01:28:01.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1680795127 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2978115440 0x7f2978175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1680795127 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810fc20 0x7f2978114c60 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=15934718305809430035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1680795127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f297810f230 0x7f297810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1680795127 >> 10.20.193.91:0/1680795127 conn(0x7f29780ecb30 msgr2=0x7f297810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1680795127 shutdown_connections 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1680795127 wait complete. 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 Processor -- start 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- start start 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 0x7f29780f4d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2978115440 0x7f2978175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f29780f5330 0x7f29780fa5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:01.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f29780f5a20 con 0x7f297810f230 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f29780faaf0 con 0x7f29780f5330 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f297dd9f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29780facb0 con 0x7f2978115440 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f29777fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 0x7f29780f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.358+0000 7f29777fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 0x7f29780f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:58264/0 (socket says 10.20.193.91:58264) 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 -- 10.20.193.91:0/1585391526 learned_addr learned my addr 10.20.193.91:0/1585391526 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f2976ffd6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2978115440 0x7f2978175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f2977fff6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f29780f5330 0x7f29780fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 -- 10.20.193.91:0/1585391526 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2978115440 msgr2=0x7f2978175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2978115440 0x7f2978175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 -- 10.20.193.91:0/1585391526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f29780f5330 msgr2=0x7f29780fa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:01.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f29780f5330 0x7f29780fa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 -- 10.20.193.91:0/1585391526 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968009590 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f2977fff6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f29780f5330 0x7f29780fa5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f29777fe6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 0x7f29780f4d00 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f296400b710 tx=0x7f296400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2964004250 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2964002d80 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29780faf90 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f296400cda0 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29780fb720 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.359+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2978110500 con 0x7f297810f230 2026-02-13T01:28:01.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.361+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f29640028c0 con 0x7f297810f230 2026-02-13T01:28:01.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.361+0000 7f2974ff96c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f294c0b5650 0x7f294c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:01.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.361+0000 7f2976ffd6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f294c0b5650 0x7f294c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:01.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.361+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f29640e3c30 con 0x7f297810f230 2026-02-13T01:28:01.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.362+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f29640a6610 con 0x7f297810f230 2026-02-13T01:28:01.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.362+0000 7f2976ffd6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f294c0b5650 0x7f294c0d5b00 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2968005b40 tx=0x7f2968005c20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:01.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.475+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f29780f5e00 con 0x7f297810f230 2026-02-13T01:28:01.476 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:01 trial091 ceph-mon[25068]: pgmap v264: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:01.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.475+0000 7f2974ff96c0 1 -- 10.20.193.91:0/1585391526 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f29640a97c0 con 0x7f297810f230 2026-02-13T01:28:01.477 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:01.477 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:01.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f294c0b5650 msgr2=0x7f294c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:01.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f294c0b5650 0x7f294c0d5b00 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2968005b40 tx=0x7f2968005c20 comp rx=0 tx=0).stop 2026-02-13T01:28:01.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 msgr2=0x7f29780f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 0x7f29780f4d00 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f296400b710 tx=0x7f296400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 shutdown_connections 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f294c0b5650 0x7f294c0d5b00 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f29780f5330 0x7f29780fa5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2978115440 0x7f2978175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 --2- 10.20.193.91:0/1585391526 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f297810f230 0x7f29780f4d00 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 >> 10.20.193.91:0/1585391526 conn(0x7f29780ecb30 msgr2=0x7f297810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 shutdown_connections 2026-02-13T01:28:01.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:01.477+0000 7f297dd9f6c0 1 -- 10.20.193.91:0/1585391526 wait complete. 2026-02-13T01:28:01.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:01 trial126 ceph-mon[26569]: pgmap v264: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:01.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:01 trial154 ceph-mon[27045]: pgmap v264: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:02.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:02 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1585391526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:02.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:02 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1585391526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:02.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:02 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1585391526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:03.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:03 trial126 ceph-mon[26569]: pgmap v265: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:03.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:03 trial154 ceph-mon[27045]: pgmap v265: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:03.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:03 trial091 ceph-mon[25068]: pgmap v265: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:04.520 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:04.639 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- 10.20.193.91:0/2617876151 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 msgr2=0x7f682010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- 10.20.193.91:0/2617876151 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682010f600 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=10692587321597957518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68100099a0 tx=0x7f681002ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- 10.20.193.91:0/2617876151 shutdown_connections 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- 10.20.193.91:0/2617876151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6820115440 0x7f6820175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- 10.20.193.91:0/2617876151 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f682010fc20 0x7f6820114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- 10.20.193.91:0/2617876151 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682010f600 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=10692587321597957518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- 10.20.193.91:0/2617876151 >> 10.20.193.91:0/2617876151 conn(0x7f68200ecb30 msgr2=0x7f682010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:04.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- 10.20.193.91:0/2617876151 shutdown_connections 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- 10.20.193.91:0/2617876151 wait complete. 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 Processor -- start 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- start start 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682011d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6820115440 0x7f682011d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6820122c20 0x7f68201230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6820123630 con 0x7f682010f230 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f68201237a0 con 0x7f6820115440 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682821f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6820123960 con 0x7f6820122c20 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f6825f906c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682011d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f6825f906c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682011d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:58286/0 (socket says 10.20.193.91:58286) 2026-02-13T01:28:04.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f6825f906c0 1 -- 10.20.193.91:0/496906063 learned_addr learned my addr 10.20.193.91:0/496906063 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.753+0000 7f682578f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6820115440 0x7f682011d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f6825f906c0 1 -- 10.20.193.91:0/496906063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6820122c20 msgr2=0x7f68201230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f68267916c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6820122c20 0x7f68201230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f6825f906c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6820122c20 0x7f68201230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f6825f906c0 1 -- 10.20.193.91:0/496906063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6820115440 msgr2=0x7f682011d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f6825f906c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6820115440 0x7f682011d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f6825f906c0 1 -- 10.20.193.91:0/496906063 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6810009590 con 0x7f682010f230 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f68267916c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6820122c20 0x7f68201230c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f6825f906c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682011d320 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f681002f230 tx=0x7f681002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6810002ba0 con 0x7f682010f230 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6810002d00 con 0x7f682010f230 2026-02-13T01:28:04.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68100372f0 con 0x7f682010f230 2026-02-13T01:28:04.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6820163db0 con 0x7f682010f230 2026-02-13T01:28:04.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68201641e0 con 0x7f682010f230 2026-02-13T01:28:04.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.754+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6820110500 con 0x7f682010f230 2026-02-13T01:28:04.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.755+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f68100078d0 con 0x7f682010f230 2026-02-13T01:28:04.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.756+0000 7f680effd6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f67fc0b5650 0x7f67fc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:04.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.756+0000 7f682578f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f67fc0b5650 0x7f67fc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:04.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.756+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f6810107d60 con 0x7f682010f230 2026-02-13T01:28:04.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.756+0000 7f682578f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f67fc0b5650 0x7f67fc0d5b00 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6814005980 tx=0x7f6814005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:04.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.757+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f68100ca700 con 0x7f682010f230 2026-02-13T01:28:04.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.872+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f682010f600 con 0x7f682010f230 2026-02-13T01:28:04.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.873+0000 7f680effd6c0 1 -- 10.20.193.91:0/496906063 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f68100cd8b0 con 0x7f682010f230 2026-02-13T01:28:04.874 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:04.874 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:04.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f67fc0b5650 msgr2=0x7f67fc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f67fc0b5650 0x7f67fc0d5b00 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6814005980 tx=0x7f6814005910 comp rx=0 tx=0).stop 2026-02-13T01:28:04.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 msgr2=0x7f682011d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:04.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682011d320 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f681002f230 tx=0x7f681002fd40 comp rx=0 tx=0).stop 2026-02-13T01:28:04.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 shutdown_connections 2026-02-13T01:28:04.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f67fc0b5650 0x7f67fc0d5b00 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6820122c20 0x7f68201230c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6820115440 0x7f682011d860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 --2- 10.20.193.91:0/496906063 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f682010f230 0x7f682011d320 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:04.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 >> 10.20.193.91:0/496906063 conn(0x7f68200ecb30 msgr2=0x7f682010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:04.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 shutdown_connections 2026-02-13T01:28:04.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:04.874+0000 7f682821f6c0 1 -- 10.20.193.91:0/496906063 wait complete. 2026-02-13T01:28:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:05 trial126 ceph-mon[26569]: pgmap v266: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:05 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/496906063' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:05.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:05 trial154 ceph-mon[27045]: pgmap v266: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:05.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:05 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/496906063' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:05 trial091 ceph-mon[25068]: pgmap v266: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:05 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/496906063' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:07.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:07 trial126 ceph-mon[26569]: pgmap v267: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:07.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:07 trial154 ceph-mon[27045]: pgmap v267: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:07.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:07 trial091 ceph-mon[25068]: pgmap v267: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:07.916 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:08.036 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:08.160 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 -- 10.20.193.91:0/2203493565 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c010fbf0 msgr2=0x7f76c0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.160 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 --2- 10.20.193.91:0/2203493565 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c010fbf0 0x7f76c0114c30 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=14417359662265441405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76b00099a0 tx=0x7f76b002ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:08.160 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 -- 10.20.193.91:0/2203493565 shutdown_connections 2026-02-13T01:28:08.160 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 --2- 10.20.193.91:0/2203493565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76c0115410 0x7f76c0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 --2- 10.20.193.91:0/2203493565 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c010fbf0 0x7f76c0114c30 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=14417359662265441405 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 --2- 10.20.193.91:0/2203493565 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76c010f200 0x7f76c010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.157+0000 7f76c61036c0 1 -- 10.20.193.91:0/2203493565 >> 10.20.193.91:0/2203493565 conn(0x7f76c00ecb00 msgr2=0x7f76c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- 10.20.193.91:0/2203493565 shutdown_connections 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- 10.20.193.91:0/2203493565 wait complete. 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 Processor -- start 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- start start 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76c010f200 0x7f76c00f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 0x7f76c0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.161 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76c00f5320 0x7f76c00fa5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00f5a10 con 0x7f76c0115410 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00fab30 con 0x7f76c010f200 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00facf0 con 0x7f76c00f5320 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 0x7f76c0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 0x7f76c0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44710/0 (socket says 10.20.193.91:44710) 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 -- 10.20.193.91:0/1294665193 learned_addr learned my addr 10.20.193.91:0/1294665193 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76bf7fe6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76c010f200 0x7f76c00f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76bffff6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76c00f5320 0x7f76c00fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 -- 10.20.193.91:0/1294665193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76c00f5320 msgr2=0x7f76c00fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76c00f5320 0x7f76c00fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 -- 10.20.193.91:0/1294665193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76c010f200 msgr2=0x7f76c00f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76c010f200 0x7f76c00f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 -- 10.20.193.91:0/1294665193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b0009590 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76beffd6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 0x7f76c0175cb0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76b0004830 tx=0x7f76b002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76b0002ae0 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f76b0002c40 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c00faf70 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.158+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76b00362f0 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.159+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c00fb410 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.159+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c01104d0 con 0x7f76c0115410 2026-02-13T01:28:08.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.160+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f76b0007810 con 0x7f76c0115410 2026-02-13T01:28:08.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.161+0000 7f76bcff96c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f76940b56d0 0x7f76940d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:08.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.161+0000 7f76bf7fe6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f76940b56d0 0x7f76940d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:08.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.161+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f76b0107ce0 con 0x7f76c0115410 2026-02-13T01:28:08.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.161+0000 7f76bf7fe6c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f76940b56d0 0x7f76940d5b80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76ac005980 tx=0x7f76ac005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:08.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.161+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f76b00ca680 con 0x7f76c0115410 2026-02-13T01:28:08.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.275+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f76c010f5d0 con 0x7f76c0115410 2026-02-13T01:28:08.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.275+0000 7f76bcff96c0 1 -- 10.20.193.91:0/1294665193 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f76b00cd830 con 0x7f76c0115410 2026-02-13T01:28:08.276 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:08.276 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.276+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f76940b56d0 msgr2=0x7f76940d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.276+0000 7f76c61036c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f76940b56d0 0x7f76940d5b80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76ac005980 tx=0x7f76ac005910 comp rx=0 tx=0).stop 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.276+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 msgr2=0x7f76c0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.276+0000 7f76c61036c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 0x7f76c0175cb0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76b0004830 tx=0x7f76b002fbf0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 shutdown_connections 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f76940b56d0 0x7f76940d5b80 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f76c00f5320 0x7f76c00fa5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f76c0115410 0x7f76c0175cb0 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 --2- 10.20.193.91:0/1294665193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f76c010f200 0x7f76c00f4cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:08.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 >> 10.20.193.91:0/1294665193 conn(0x7f76c00ecb00 msgr2=0x7f76c010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:08.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 shutdown_connections 2026-02-13T01:28:08.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:08.277+0000 7f76c61036c0 1 -- 10.20.193.91:0/1294665193 wait complete. 2026-02-13T01:28:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:09 trial126 ceph-mon[26569]: pgmap v268: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:09.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:09 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1294665193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:09.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:09 trial154 ceph-mon[27045]: pgmap v268: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:09.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:09 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1294665193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:09.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:09 trial091 ceph-mon[25068]: pgmap v268: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:09.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:09 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1294665193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:11.319 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:11.439 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:11.488 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:11 trial091 ceph-mon[25068]: pgmap v269: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:11.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/2217918041 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e28115440 msgr2=0x7f4e28175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/2217918041 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e28115440 0x7f4e28175de0 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=13367573328831138252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e1800aa70 tx=0x7f4e1802fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.557 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/2217918041 shutdown_connections 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/2217918041 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e28115440 0x7f4e28175de0 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=13367573328831138252 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/2217918041 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e2810fc20 0x7f4e28114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/2217918041 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e2810f230 0x7f4e2810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/2217918041 >> 10.20.193.91:0/2217918041 conn(0x7f4e280ecb30 msgr2=0x7f4e2810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/2217918041 shutdown_connections 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/2217918041 wait complete. 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 Processor -- start 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- start start 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 0x7f4e2811d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e28115440 0x7f4e2811d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e28122b00 0x7f4e28122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4e28123510 con 0x7f4e2810f230 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4e28123680 con 0x7f4e28122b00 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4e28123840 con 0x7f4e28115440 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 0x7f4e2811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 0x7f4e2811d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44732/0 (socket says 10.20.193.91:44732) 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 -- 10.20.193.91:0/989498771 learned_addr learned my addr 10.20.193.91:0/989498771 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e277fe6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e28122b00 0x7f4e28122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e267fc6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e28115440 0x7f4e2811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 -- 10.20.193.91:0/989498771 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e28115440 msgr2=0x7f4e2811d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e28115440 0x7f4e2811d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 -- 10.20.193.91:0/989498771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e28122b00 msgr2=0x7f4e28122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e28122b00 0x7f4e28122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 -- 10.20.193.91:0/989498771 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1800a660 con 0x7f4e2810f230 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e26ffd6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 0x7f4e2811d200 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e1c009490 tx=0x7f4e1c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e1c004a80 con 0x7f4e2810f230 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e28163cf0 con 0x7f4e2810f230 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4e1c009030 con 0x7f4e2810f230 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.556+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e1c00cdd0 con 0x7f4e2810f230 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.557+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e28164180 con 0x7f4e2810f230 2026-02-13T01:28:11.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.557+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e28110500 con 0x7f4e2810f230 2026-02-13T01:28:11.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.558+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4e1c005000 con 0x7f4e2810f230 2026-02-13T01:28:11.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.559+0000 7f4e2c9426c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4dfc0b5650 0x7f4dfc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:11.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.559+0000 7f4e267fc6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4dfc0b5650 0x7f4dfc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:11.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.559+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f4e1c0e3d30 con 0x7f4e2810f230 2026-02-13T01:28:11.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.559+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4e1c0e41b0 con 0x7f4e2810f230 2026-02-13T01:28:11.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.559+0000 7f4e267fc6c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4dfc0b5650 0x7f4dfc0d5b00 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e10005fd0 tx=0x7f4e10005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:11.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:11 trial126 ceph-mon[26569]: pgmap v269: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:11.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.674+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4e2810f600 con 0x7f4e2810f230 2026-02-13T01:28:11.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.674+0000 7f4e2c9426c0 1 -- 10.20.193.91:0/989498771 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4e1c0a66d0 con 0x7f4e2810f230 2026-02-13T01:28:11.674 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:11.674 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:11.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4dfc0b5650 msgr2=0x7f4dfc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4dfc0b5650 0x7f4dfc0d5b00 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e10005fd0 tx=0x7f4e10005910 comp rx=0 tx=0).stop 2026-02-13T01:28:11.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 msgr2=0x7f4e2811d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:11.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 0x7f4e2811d200 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e1c009490 tx=0x7f4e1c00bc50 comp rx=0 tx=0).stop 2026-02-13T01:28:11.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 shutdown_connections 2026-02-13T01:28:11.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4dfc0b5650 0x7f4dfc0d5b00 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4e28122b00 0x7f4e28122fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4e28115440 0x7f4e2811d740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 --2- 10.20.193.91:0/989498771 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4e2810f230 0x7f4e2811d200 unknown :-1 s=CLOSED pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:11.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 >> 10.20.193.91:0/989498771 conn(0x7f4e280ecb30 msgr2=0x7f4e2810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:11.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 shutdown_connections 2026-02-13T01:28:11.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:11.675+0000 7f4e2d9446c0 1 -- 10.20.193.91:0/989498771 wait complete. 2026-02-13T01:28:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:11 trial154 ceph-mon[27045]: pgmap v269: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:12.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:12 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/989498771' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:12.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:12 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/989498771' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:12.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:12 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/989498771' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:13.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:13 trial126 ceph-mon[26569]: pgmap v270: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:13.628 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:13 trial091 ceph-mon[25068]: pgmap v270: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:13 trial154 ceph-mon[27045]: pgmap v270: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:14 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:14 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:14.718 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:14 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:28:14.834 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:14.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/753834341 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab010f050 msgr2=0x7f4ab010f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:14.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/753834341 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab010f050 0x7f4ab010f420 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=10505103702988138480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a9c0099a0 tx=0x7f4a9c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/753834341 shutdown_connections 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/753834341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 0x7f4ab0175c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/753834341 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4ab010fa40 0x7f4ab0114a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/753834341 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab010f050 0x7f4ab010f420 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=10505103702988138480 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.954+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/753834341 >> 10.20.193.91:0/753834341 conn(0x7f4ab00ec950 msgr2=0x7f4ab010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/753834341 shutdown_connections 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/753834341 wait complete. 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 Processor -- start 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 -- start start 2026-02-13T01:28:14.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4ab010f050 0x7f4ab011d100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 0x7f4ab011d640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 0x7f4ab0122ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0123410 con 0x7f4ab0122a00 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0123580 con 0x7f4ab0115260 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4ab4e6b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0123740 con 0x7f4ab010f050 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 0x7f4ab0122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 0x7f4ab0122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44754/0 (socket says 10.20.193.91:44754) 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 -- 10.20.193.91:0/2818653146 learned_addr learned my addr 10.20.193.91:0/2818653146 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaf7fe6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4ab010f050 0x7f4ab011d100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaeffd6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 0x7f4ab011d640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:14.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 -- 10.20.193.91:0/2818653146 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4ab010f050 msgr2=0x7f4ab011d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4ab010f050 0x7f4ab011d100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 -- 10.20.193.91:0/2818653146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 msgr2=0x7f4ab011d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 0x7f4ab011d640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 -- 10.20.193.91:0/2818653146 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c009590 con 0x7f4ab0122a00 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaeffd6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 0x7f4ab011d640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aaffff6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 0x7f4ab0122ea0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4aa4006a60 tx=0x7f4aa400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4aa4003c40 con 0x7f4ab0122a00 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.955+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4aa400a070 con 0x7f4ab0122a00 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.956+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4aa400dda0 con 0x7f4ab0122a00 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.956+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab0163bf0 con 0x7f4ab0122a00 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.956+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab0164080 con 0x7f4ab0122a00 2026-02-13T01:28:14.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.956+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab0110320 con 0x7f4ab0122a00 2026-02-13T01:28:14.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.957+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4aa4005030 con 0x7f4ab0122a00 2026-02-13T01:28:14.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.958+0000 7f4aacff96c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4a840b5650 0x7f4a840d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:14.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.958+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f4aa40e4c30 con 0x7f4ab0122a00 2026-02-13T01:28:14.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.958+0000 7f4aaf7fe6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4a840b5650 0x7f4a840d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:14.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.958+0000 7f4aaf7fe6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4a840b5650 0x7f4a840d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a9c0023e0 tx=0x7f4a9c005c60 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:14.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:14.959+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4aa40a75d0 con 0x7f4ab0122a00 2026-02-13T01:28:15.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.072+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4ab010f420 con 0x7f4ab0122a00 2026-02-13T01:28:15.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.072+0000 7f4aacff96c0 1 -- 10.20.193.91:0/2818653146 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4aa40aa780 con 0x7f4ab0122a00 2026-02-13T01:28:15.072 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:15.072 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4a840b5650 msgr2=0x7f4a840d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4a840b5650 0x7f4a840d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4a9c0023e0 tx=0x7f4a9c005c60 comp rx=0 tx=0).stop 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 msgr2=0x7f4ab0122ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 0x7f4ab0122ea0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4aa4006a60 tx=0x7f4aa400cca0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 shutdown_connections 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4a840b5650 0x7f4a840d5b00 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4ab0122a00 0x7f4ab0122ea0 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ab0115260 0x7f4ab011d640 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 --2- 10.20.193.91:0/2818653146 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4ab010f050 0x7f4ab011d100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:15.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 >> 10.20.193.91:0/2818653146 conn(0x7f4ab00ec950 msgr2=0x7f4ab010cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:15.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 shutdown_connections 2026-02-13T01:28:15.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:15.073+0000 7f4ab4e6b6c0 1 -- 10.20.193.91:0/2818653146 wait complete. 2026-02-13T01:28:15.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: pgmap v271: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:15.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:15.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:28:15.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:28:15.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:28:15.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:28:15.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:15.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:15 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2818653146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:15.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: pgmap v271: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:15.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:15.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:28:15.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:28:15.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:28:15.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:28:15.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:15.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:15 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2818653146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:15.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: pgmap v271: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:15.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:15.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:28:15.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:28:15.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:28:15.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:28:15.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:28:15.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:15 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2818653146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:16.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:16 trial126 ceph-mon[26569]: pgmap v272: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T01:28:16.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:16 trial126 ceph-mon[26569]: pgmap v273: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:28:16.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:16 trial154 ceph-mon[27045]: pgmap v272: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T01:28:16.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:16 trial154 ceph-mon[27045]: pgmap v273: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:28:16.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:16 trial091 ceph-mon[25068]: pgmap v272: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T01:28:16.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:16 trial091 ceph-mon[25068]: pgmap v273: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:28:18.113 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:18.231 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:18.348 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 -- 10.20.193.91:0/1877775038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c153350 msgr2=0x7f838c173730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1877775038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c153350 0x7f838c173730 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=3971167944067965057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f837c009970 tx=0x7f837c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 -- 10.20.193.91:0/1877775038 shutdown_connections 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1877775038 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c153350 0x7f838c173730 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=3971167944067965057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1877775038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c10e790 0x7f838c152d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1877775038 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10dda0 0x7f838c10e170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 -- 10.20.193.91:0/1877775038 >> 10.20.193.91:0/1877775038 conn(0x7f838c0e9740 msgr2=0x7f838c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 -- 10.20.193.91:0/1877775038 shutdown_connections 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.346+0000 7f839117c6c0 1 -- 10.20.193.91:0/1877775038 wait complete. 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 Processor -- start 2026-02-13T01:28:18.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 -- start start 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 0x7f838c10bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10e790 0x7f838c10c0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c153350 0x7f838c10c620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f838c14eca0 con 0x7f838c10dda0 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f838c14ee10 con 0x7f838c153350 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f838c14efd0 con 0x7f838c10e790 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 0x7f838c10bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 0x7f838c10bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:35284/0 (socket says 10.20.193.91:35284) 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 -- 10.20.193.91:0/1042136282 learned_addr learned my addr 10.20.193.91:0/1042136282 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838a5756c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10e790 0x7f838c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838b5776c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c153350 0x7f838c10c620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 -- 10.20.193.91:0/1042136282 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10e790 msgr2=0x7f838c10c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10e790 0x7f838c10c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 -- 10.20.193.91:0/1042136282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c153350 msgr2=0x7f838c10c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c153350 0x7f838c10c620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 -- 10.20.193.91:0/1042136282 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c009590 con 0x7f838c10dda0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838a5756c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10e790 0x7f838c10c0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f838ad766c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 0x7f838c10bba0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8380006ea0 tx=0x7f838000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8380003a30 con 0x7f838c10dda0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c14f2b0 con 0x7f838c10dda0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f83800054f0 con 0x7f838c10dda0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f838000dd30 con 0x7f838c10dda0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.347+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c14f790 con 0x7f838c10dda0 2026-02-13T01:28:18.351 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.348+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f838c05fb30 con 0x7f838c10dda0 2026-02-13T01:28:18.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.349+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8380005030 con 0x7f838c10dda0 2026-02-13T01:28:18.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.350+0000 7f836bfff6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f83600b5650 0x7f83600d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:18.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.350+0000 7f838a5756c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f83600b5650 0x7f83600d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:18.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.350+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f83800e4cd0 con 0x7f838c10dda0 2026-02-13T01:28:18.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.350+0000 7f838a5756c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f83600b5650 0x7f83600d5b00 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f838c10ac00 tx=0x7f83740095b0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:18.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.350+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f83800a7670 con 0x7f838c10dda0 2026-02-13T01:28:18.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.467+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f838c10e170 con 0x7f838c10dda0 2026-02-13T01:28:18.467 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:18 trial091 ceph-mon[25068]: pgmap v274: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:28:18.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.467+0000 7f836bfff6c0 1 -- 10.20.193.91:0/1042136282 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f83800aa820 con 0x7f838c10dda0 2026-02-13T01:28:18.468 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:18.468 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f83600b5650 msgr2=0x7f83600d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f83600b5650 0x7f83600d5b00 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f838c10ac00 tx=0x7f83740095b0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 msgr2=0x7f838c10bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 0x7f838c10bba0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8380006ea0 tx=0x7f838000cca0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 shutdown_connections 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f83600b5650 0x7f83600d5b00 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c153350 0x7f838c10c620 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f838c10e790 0x7f838c10c0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 --2- 10.20.193.91:0/1042136282 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f838c10dda0 0x7f838c10bba0 unknown :-1 s=CLOSED pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:18.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 >> 10.20.193.91:0/1042136282 conn(0x7f838c0e9740 msgr2=0x7f838c109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:18.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 shutdown_connections 2026-02-13T01:28:18.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:18.468+0000 7f839117c6c0 1 -- 10.20.193.91:0/1042136282 wait complete. 2026-02-13T01:28:18.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:18 trial126 ceph-mon[26569]: pgmap v274: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:28:18.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:18 trial154 ceph-mon[27045]: pgmap v274: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:28:19.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:19 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1042136282' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:19.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:19 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1042136282' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:19.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:19 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1042136282' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:20.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:20 trial126 ceph-mon[26569]: pgmap v275: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:28:20.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:20 trial154 ceph-mon[27045]: pgmap v275: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:28:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:20 trial091 ceph-mon[25068]: pgmap v275: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:28:21.510 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:21.628 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:21.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/1386859729 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 msgr2=0x7f1b6810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/1386859729 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6810f5d0 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=1294661433498960891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5c0099a0 tx=0x7f1b5c02ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/1386859729 shutdown_connections 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/1386859729 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b68115410 0x7f1b68175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/1386859729 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b6810fbf0 0x7f1b68114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/1386859729 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6810f5d0 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=1294661433498960891 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/1386859729 >> 10.20.193.91:0/1386859729 conn(0x7f1b680ecb00 msgr2=0x7f1b6810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/1386859729 shutdown_connections 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/1386859729 wait complete. 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 Processor -- start 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- start start 2026-02-13T01:28:21.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b68115410 0x7f1b6811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b68122c30 0x7f1b681230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68123640 con 0x7f1b6810f200 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b681237b0 con 0x7f1b68122c30 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b6cefc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b68123970 con 0x7f1b68115410 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b665756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b665756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6811d330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:35310/0 (socket says 10.20.193.91:35310) 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.744+0000 7f1b665756c0 1 -- 10.20.193.91:0/222362269 learned_addr learned my addr 10.20.193.91:0/222362269 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b665756c0 1 -- 10.20.193.91:0/222362269 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b68115410 msgr2=0x7f1b6811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b665756c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b68115410 0x7f1b6811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b665756c0 1 -- 10.20.193.91:0/222362269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b68122c30 msgr2=0x7f1b681230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b665756c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b68122c30 0x7f1b681230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b665756c0 1 -- 10.20.193.91:0/222362269 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c009590 con 0x7f1b6810f200 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b665756c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6811d330 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5c02f230 tx=0x7f1b5c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b5c002ba0 con 0x7f1b6810f200 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1b5c002d00 con 0x7f1b6810f200 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b68163dc0 con 0x7f1b6810f200 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b5c0372f0 con 0x7f1b6810f200 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b681641f0 con 0x7f1b6810f200 2026-02-13T01:28:21.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.745+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b681104d0 con 0x7f1b6810f200 2026-02-13T01:28:21.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.746+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1b5c0078d0 con 0x7f1b6810f200 2026-02-13T01:28:21.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.747+0000 7f1b4f7fe6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b400b5650 0x7f1b400d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:21.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.747+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f1b5c107e10 con 0x7f1b6810f200 2026-02-13T01:28:21.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.747+0000 7f1b65d746c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b400b5650 0x7f1b400d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:21.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.747+0000 7f1b65d746c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b400b5650 0x7f1b400d5b00 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b50005980 tx=0x7f1b50005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:21.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.747+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1b5c0ca7b0 con 0x7f1b6810f200 2026-02-13T01:28:21.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.865+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b6810f5d0 con 0x7f1b6810f200 2026-02-13T01:28:21.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.865+0000 7f1b4f7fe6c0 1 -- 10.20.193.91:0/222362269 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1b5c0cd960 con 0x7f1b6810f200 2026-02-13T01:28:21.866 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:21.867 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b400b5650 msgr2=0x7f1b400d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b400b5650 0x7f1b400d5b00 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b50005980 tx=0x7f1b50005910 comp rx=0 tx=0).stop 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 msgr2=0x7f1b6811d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6811d330 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b5c02f230 tx=0x7f1b5c02fd40 comp rx=0 tx=0).stop 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 shutdown_connections 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b400b5650 0x7f1b400d5b00 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b68122c30 0x7f1b681230d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b68115410 0x7f1b6811d870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 --2- 10.20.193.91:0/222362269 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b6810f200 0x7f1b6811d330 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:21.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 >> 10.20.193.91:0/222362269 conn(0x7f1b680ecb00 msgr2=0x7f1b6810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:21.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 shutdown_connections 2026-02-13T01:28:21.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:21.866+0000 7f1b6cefc6c0 1 -- 10.20.193.91:0/222362269 wait complete. 2026-02-13T01:28:22.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:22 trial126 ceph-mon[26569]: pgmap v276: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:28:22.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:22 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/222362269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:22 trial154 ceph-mon[27045]: pgmap v276: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:28:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:22 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/222362269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:22.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:22 trial091 ceph-mon[25068]: pgmap v276: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:28:22.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:22 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/222362269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:24.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:24 trial126 ceph-mon[26569]: pgmap v277: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:28:24.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:24 trial154 ceph-mon[27045]: pgmap v277: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:28:24.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:24 trial091 ceph-mon[25068]: pgmap v277: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:28:24.907 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:25.029 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:25.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- 10.20.193.91:0/2253342212 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8115440 msgr2=0x7f7aa8175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/2253342212 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8115440 0x7f7aa8175de0 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=18151164093483701763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7aa400aa70 tx=0x7f7aa402fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- 10.20.193.91:0/2253342212 shutdown_connections 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/2253342212 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8115440 0x7f7aa8175de0 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=18151164093483701763 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/2253342212 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7aa810fc20 0x7f7aa8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/2253342212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7aa810f230 0x7f7aa810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- 10.20.193.91:0/2253342212 >> 10.20.193.91:0/2253342212 conn(0x7f7aa80ecb30 msgr2=0x7f7aa810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- 10.20.193.91:0/2253342212 shutdown_connections 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- 10.20.193.91:0/2253342212 wait complete. 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 Processor -- start 2026-02-13T01:28:25.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- start start 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7aa810f230 0x7f7aa811d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7aa8115440 0x7f7aa811d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 0x7f7aa8122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8123500 con 0x7f7aa8122af0 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8123670 con 0x7f7aa8115440 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7ab05906c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8123830 con 0x7f7aa810f230 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7aaeb026c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 0x7f7aa8122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7aaeb026c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 0x7f7aa8122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:35314/0 (socket says 10.20.193.91:35314) 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.145+0000 7f7aaeb026c0 1 -- 10.20.193.91:0/3822196712 learned_addr learned my addr 10.20.193.91:0/3822196712 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aadb006c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7aa8115440 0x7f7aa811d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:25.149 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aae3016c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7aa810f230 0x7f7aa811d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aaeb026c0 1 -- 10.20.193.91:0/3822196712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7aa810f230 msgr2=0x7f7aa811d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aaeb026c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7aa810f230 0x7f7aa811d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aaeb026c0 1 -- 10.20.193.91:0/3822196712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7aa8115440 msgr2=0x7f7aa811d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aaeb026c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7aa8115440 0x7f7aa811d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aaeb026c0 1 -- 10.20.193.91:0/3822196712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa400a660 con 0x7f7aa8122af0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7aaeb026c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 0x7f7aa8122f90 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7aa40054b0 tx=0x7f7aa40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7aa4003a30 con 0x7f7aa8122af0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7aa4003b90 con 0x7f7aa8122af0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa8163c80 con 0x7f7aa8122af0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7aa40382f0 con 0x7f7aa8122af0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa81640b0 con 0x7f7aa8122af0 2026-02-13T01:28:25.150 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.146+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa8110500 con 0x7f7aa8122af0 2026-02-13T01:28:25.151 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.148+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7aa4008260 con 0x7f7aa8122af0 2026-02-13T01:28:25.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.149+0000 7f7a8f7fe6c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a840b5650 0x7f7a840d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:25.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.149+0000 7f7aae3016c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a840b5650 0x7f7a840d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:25.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.149+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7aa4108ff0 con 0x7f7aa8122af0 2026-02-13T01:28:25.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.149+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7aa40cb9b0 con 0x7f7aa8122af0 2026-02-13T01:28:25.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.149+0000 7f7aae3016c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a840b5650 0x7f7a840d5b00 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a98005980 tx=0x7f7a98005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:25.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.271+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7aa811e340 con 0x7f7aa8122af0 2026-02-13T01:28:25.272 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:25.273 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.271+0000 7f7a8f7fe6c0 1 -- 10.20.193.91:0/3822196712 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7aa40cf410 con 0x7f7aa8122af0 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a840b5650 msgr2=0x7f7a840d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a840b5650 0x7f7a840d5b00 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a98005980 tx=0x7f7a98005910 comp rx=0 tx=0).stop 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 msgr2=0x7f7aa8122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 0x7f7aa8122f90 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7aa40054b0 tx=0x7f7aa40054e0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 shutdown_connections 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7a840b5650 0x7f7a840d5b00 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7aa8122af0 0x7f7aa8122f90 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7aa8115440 0x7f7aa811d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 --2- 10.20.193.91:0/3822196712 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7aa810f230 0x7f7aa811d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:25.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 >> 10.20.193.91:0/3822196712 conn(0x7f7aa80ecb30 msgr2=0x7f7aa810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:25.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 shutdown_connections 2026-02-13T01:28:25.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:25.272+0000 7f7ab05906c0 1 -- 10.20.193.91:0/3822196712 wait complete. 2026-02-13T01:28:26.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:26 trial126 ceph-mon[26569]: pgmap v278: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:28:26.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:26 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3822196712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:26.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:26 trial154 ceph-mon[27045]: pgmap v278: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:28:26.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:26 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3822196712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:26.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:26 trial091 ceph-mon[25068]: pgmap v278: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:28:26.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:26 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3822196712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:28.315 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:28.431 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:28.517 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:28 trial154 ceph-mon[27045]: pgmap v279: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:28.547 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:28 trial091 ceph-mon[25068]: pgmap v279: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:28.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- 10.20.193.91:0/1137852060 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0115410 msgr2=0x7f00d0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/1137852060 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0115410 0x7f00d0175db0 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=2241175477319853832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c000aa70 tx=0x7f00c002fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- 10.20.193.91:0/1137852060 shutdown_connections 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/1137852060 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0115410 0x7f00d0175db0 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=2241175477319853832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/1137852060 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00d010fbf0 0x7f00d0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/1137852060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00d010f200 0x7f00d010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- 10.20.193.91:0/1137852060 >> 10.20.193.91:0/1137852060 conn(0x7f00d00ecb00 msgr2=0x7f00d010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- 10.20.193.91:0/1137852060 shutdown_connections 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- 10.20.193.91:0/1137852060 wait complete. 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 Processor -- start 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- start start 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00d010f200 0x7f00d011d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00d0115410 0x7f00d011d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 0x7f00d0122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0123560 con 0x7f00d0122b50 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01236d0 con 0x7f00d0115410 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00d592f6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0123890 con 0x7f00d010f200 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00cf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 0x7f00d0122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00cf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 0x7f00d0122ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45506/0 (socket says 10.20.193.91:45506) 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.549+0000 7f00cf7fe6c0 1 -- 10.20.193.91:0/2447629520 learned_addr learned my addr 10.20.193.91:0/2447629520 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00ceffd6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00d010f200 0x7f00d011d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00ce7fc6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00d0115410 0x7f00d011d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00cf7fe6c0 1 -- 10.20.193.91:0/2447629520 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00d010f200 msgr2=0x7f00d011d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00cf7fe6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00d010f200 0x7f00d011d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00cf7fe6c0 1 -- 10.20.193.91:0/2447629520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00d0115410 msgr2=0x7f00d011d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00cf7fe6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00d0115410 0x7f00d011d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00cf7fe6c0 1 -- 10.20.193.91:0/2447629520 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c000a660 con 0x7f00d0122b50 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00cf7fe6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 0x7f00d0122ff0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c00054b0 tx=0x7f00c00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00c0003a30 con 0x7f00d0122b50 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f00c0003b90 con 0x7f00d0122b50 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d0163ce0 con 0x7f00d0122b50 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00c00382f0 con 0x7f00d0122b50 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d0164110 con 0x7f00d0122b50 2026-02-13T01:28:28.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.550+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d01104d0 con 0x7f00d0122b50 2026-02-13T01:28:28.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.551+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f00c0008260 con 0x7f00d0122b50 2026-02-13T01:28:28.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.552+0000 7f00d49296c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00a40b5650 0x7f00a40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:28.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.552+0000 7f00ceffd6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00a40b5650 0x7f00a40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:28.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.552+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f00c0109070 con 0x7f00d0122b50 2026-02-13T01:28:28.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.552+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00c00cebc0 con 0x7f00d0122b50 2026-02-13T01:28:28.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.552+0000 7f00ceffd6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00a40b5650 0x7f00a40d5b00 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c4006b60 tx=0x7f00c4006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:28.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:28 trial126 ceph-mon[26569]: pgmap v279: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:28.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.666+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00d011e3a0 con 0x7f00d0122b50 2026-02-13T01:28:28.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.666+0000 7f00d49296c0 1 -- 10.20.193.91:0/2447629520 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00c00ceda0 con 0x7f00d0122b50 2026-02-13T01:28:28.667 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:28.667 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:28.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00a40b5650 msgr2=0x7f00a40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00a40b5650 0x7f00a40d5b00 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c4006b60 tx=0x7f00c4006af0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 msgr2=0x7f00d0122ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:28.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 0x7f00d0122ff0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c00054b0 tx=0x7f00c00054e0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 shutdown_connections 2026-02-13T01:28:28.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f00a40b5650 0x7f00a40d5b00 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f00d0122b50 0x7f00d0122ff0 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00d0115410 0x7f00d011d790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 --2- 10.20.193.91:0/2447629520 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f00d010f200 0x7f00d011d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:28.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 >> 10.20.193.91:0/2447629520 conn(0x7f00d00ecb00 msgr2=0x7f00d010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:28.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 shutdown_connections 2026-02-13T01:28:28.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:28.667+0000 7f00d592f6c0 1 -- 10.20.193.91:0/2447629520 wait complete. 2026-02-13T01:28:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:29 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2447629520' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:29.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:29 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2447629520' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:29.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:29 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2447629520' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:30 trial126 ceph-mon[26569]: pgmap v280: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:30.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:30 trial154 ceph-mon[27045]: pgmap v280: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:30.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:30 trial091 ceph-mon[25068]: pgmap v280: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:31.711 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:31.831 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 -- 10.20.193.91:0/3519392569 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa080115440 msgr2=0x7fa080175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3519392569 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa080115440 0x7fa080175de0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=6021706129642569989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa07000aa70 tx=0x7fa07002fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 -- 10.20.193.91:0/3519392569 shutdown_connections 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3519392569 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa080115440 0x7fa080175de0 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=6021706129642569989 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3519392569 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa08010fc20 0x7fa080114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3519392569 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa08010f230 0x7fa08010f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 -- 10.20.193.91:0/3519392569 >> 10.20.193.91:0/3519392569 conn(0x7fa0800ecb30 msgr2=0x7fa08010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:31.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 -- 10.20.193.91:0/3519392569 shutdown_connections 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 -- 10.20.193.91:0/3519392569 wait complete. 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.952+0000 7fa0854606c0 1 Processor -- start 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 -- start start 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 0x7fa08011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa080115440 0x7fa08011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa080122af0 0x7fa080122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa080123500 con 0x7fa08010f230 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa080123670 con 0x7fa080115440 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa080123830 con 0x7fa080122af0 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 0x7fa08011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 0x7fa08011d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45526/0 (socket says 10.20.193.91:45526) 2026-02-13T01:28:31.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 -- 10.20.193.91:0/3786517776 learned_addr learned my addr 10.20.193.91:0/3786517776 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 -- 10.20.193.91:0/3786517776 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa080122af0 msgr2=0x7fa080122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07e7fc6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa080115440 0x7fa08011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa080122af0 0x7fa080122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 -- 10.20.193.91:0/3786517776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa080115440 msgr2=0x7fa08011d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa080115440 0x7fa08011d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 -- 10.20.193.91:0/3786517776 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07000a660 con 0x7fa08010f230 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa07effd6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 0x7fa08011d1f0 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa07400b710 tx=0x7fa07400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa074004250 con 0x7fa08010f230 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa080163ce0 con 0x7fa08010f230 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa074002d80 con 0x7fa08010f230 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa07400cdc0 con 0x7fa08010f230 2026-02-13T01:28:31.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.953+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0801641c0 con 0x7fa08010f230 2026-02-13T01:28:31.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.954+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa080110500 con 0x7fa08010f230 2026-02-13T01:28:31.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.955+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa0740028c0 con 0x7fa08010f230 2026-02-13T01:28:31.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.956+0000 7fa05ffff6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa0540b5650 0x7fa0540d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:31.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.956+0000 7fa07e7fc6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa0540b5650 0x7fa0540d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:31.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.956+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fa0740e3d70 con 0x7fa08010f230 2026-02-13T01:28:31.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.956+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa0740a96e0 con 0x7fa08010f230 2026-02-13T01:28:31.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:31.956+0000 7fa07e7fc6c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa0540b5650 0x7fa0540d5b00 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa068005fd0 tx=0x7fa068005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:32.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.069+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa08010f600 con 0x7fa08010f230 2026-02-13T01:28:32.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.069+0000 7fa05ffff6c0 1 -- 10.20.193.91:0/3786517776 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa0740a98c0 con 0x7fa08010f230 2026-02-13T01:28:32.070 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:32.070 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:32.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa0540b5650 msgr2=0x7fa0540d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:32.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa0540b5650 0x7fa0540d5b00 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa068005fd0 tx=0x7fa068005910 comp rx=0 tx=0).stop 2026-02-13T01:28:32.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 msgr2=0x7fa08011d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 0x7fa08011d1f0 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa07400b710 tx=0x7fa07400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 shutdown_connections 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa0540b5650 0x7fa0540d5b00 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa080122af0 0x7fa080122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa080115440 0x7fa08011d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 --2- 10.20.193.91:0/3786517776 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa08010f230 0x7fa08011d1f0 unknown :-1 s=CLOSED pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 >> 10.20.193.91:0/3786517776 conn(0x7fa0800ecb30 msgr2=0x7fa08010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 shutdown_connections 2026-02-13T01:28:32.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:32.070+0000 7fa0854606c0 1 -- 10.20.193.91:0/3786517776 wait complete. 2026-02-13T01:28:32.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:32 trial091 ceph-mon[25068]: pgmap v281: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:32.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:32 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3786517776' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:32 trial126 ceph-mon[26569]: pgmap v281: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:32 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3786517776' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:32.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:32 trial154 ceph-mon[27045]: pgmap v281: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:32.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:32 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3786517776' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:34.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:34 trial126 ceph-mon[26569]: pgmap v282: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:34.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:34 trial154 ceph-mon[27045]: pgmap v282: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:34.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:34 trial091 ceph-mon[25068]: pgmap v282: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:35.113 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:35.235 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 -- 10.20.193.91:0/1031520532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572010fbf0 msgr2=0x7f5720114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 --2- 10.20.193.91:0/1031520532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572010fbf0 0x7f5720114c30 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=3643119977505988408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57080099a0 tx=0x7f570802ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 -- 10.20.193.91:0/1031520532 shutdown_connections 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 --2- 10.20.193.91:0/1031520532 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5720115410 0x7f5720175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 --2- 10.20.193.91:0/1031520532 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f572010fbf0 0x7f5720114c30 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=3643119977505988408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 --2- 10.20.193.91:0/1031520532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 0x7f572010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 -- 10.20.193.91:0/1031520532 >> 10.20.193.91:0/1031520532 conn(0x7f57200ecb00 msgr2=0x7f572010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 -- 10.20.193.91:0/1031520532 shutdown_connections 2026-02-13T01:28:35.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.354+0000 7f572505c6c0 1 -- 10.20.193.91:0/1031520532 wait complete. 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 Processor -- start 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 -- start start 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 0x7f57200f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5720115410 0x7f5720175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 0x7f57200fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f57200f59b0 con 0x7f57200f52c0 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f57200faad0 con 0x7f572010f200 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f57200fac90 con 0x7f5720115410 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 0x7f57200fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 0x7f57200fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:45542/0 (socket says 10.20.193.91:45542) 2026-02-13T01:28:35.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 -- 10.20.193.91:0/760590553 learned_addr learned my addr 10.20.193.91:0/760590553 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571ed766c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 0x7f57200f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571e5756c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5720115410 0x7f5720175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 -- 10.20.193.91:0/760590553 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5720115410 msgr2=0x7f5720175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5720115410 0x7f5720175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 -- 10.20.193.91:0/760590553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 msgr2=0x7f57200f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 0x7f57200f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 -- 10.20.193.91:0/760590553 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5708009590 con 0x7f57200f52c0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571ed766c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 0x7f57200f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f571f5776c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 0x7f57200fa590 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5710006ea0 tx=0x7f571000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5710003a30 con 0x7f57200f52c0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f57100054f0 con 0x7f57200f52c0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57200faf70 con 0x7f57200f52c0 2026-02-13T01:28:35.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f571000dcd0 con 0x7f57200f52c0 2026-02-13T01:28:35.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.355+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57200fb400 con 0x7f57200f52c0 2026-02-13T01:28:35.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.356+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57201104d0 con 0x7f57200f52c0 2026-02-13T01:28:35.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.357+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f5710003b90 con 0x7f57200f52c0 2026-02-13T01:28:35.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.358+0000 7f56fffff6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f56f40b5650 0x7f56f40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:35.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.358+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f57100e4ac0 con 0x7f57200f52c0 2026-02-13T01:28:35.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.358+0000 7f571ed766c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f56f40b5650 0x7f56f40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:35.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.358+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f57100a74a0 con 0x7f57200f52c0 2026-02-13T01:28:35.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.358+0000 7f571ed766c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f56f40b5650 0x7f56f40d5b00 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714004750 tx=0x7f5714009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:35.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.472+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f57200fb400 con 0x7f57200f52c0 2026-02-13T01:28:35.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.472+0000 7f56fffff6c0 1 -- 10.20.193.91:0/760590553 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f571000de60 con 0x7f57200f52c0 2026-02-13T01:28:35.473 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:35.473 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f56f40b5650 msgr2=0x7f56f40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f56f40b5650 0x7f56f40d5b00 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5714004750 tx=0x7f5714009260 comp rx=0 tx=0).stop 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 msgr2=0x7f57200fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 0x7f57200fa590 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5710006ea0 tx=0x7f571000cca0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 shutdown_connections 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f56f40b5650 0x7f56f40d5b00 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f57200f52c0 0x7f57200fa590 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5720115410 0x7f5720175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 --2- 10.20.193.91:0/760590553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f572010f200 0x7f57200f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:35.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 >> 10.20.193.91:0/760590553 conn(0x7f57200ecb00 msgr2=0x7f5720113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:35.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 shutdown_connections 2026-02-13T01:28:35.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:35.473+0000 7f572505c6c0 1 -- 10.20.193.91:0/760590553 wait complete. 2026-02-13T01:28:36.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:36 trial126 ceph-mon[26569]: pgmap v283: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:36.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:36 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/760590553' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:36.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:36 trial154 ceph-mon[27045]: pgmap v283: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:36.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:36 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/760590553' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:36.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:36 trial091 ceph-mon[25068]: pgmap v283: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:36.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:36 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/760590553' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:38.516 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:38.539 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:38 trial091 ceph-mon[25068]: pgmap v284: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:38.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:38 trial126 ceph-mon[26569]: pgmap v284: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:38.635 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:38.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:38 trial154 ceph-mon[27045]: pgmap v284: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/2885845371 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10d9a0 msgr2=0x7fd85c1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/2885845371 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10d9a0 0x7fd85c1129e0 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=14009479785856081837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8500099a0 tx=0x7fd85002ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/2885845371 shutdown_connections 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/2885845371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 0x7fd85c173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/2885845371 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10d9a0 0x7fd85c1129e0 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=14009479785856081837 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/2885845371 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c10cfb0 0x7fd85c10d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.748+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/2885845371 >> 10.20.193.91:0/2885845371 conn(0x7fd85c0ea8b0 msgr2=0x7fd85c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:38.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/2885845371 shutdown_connections 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/2885845371 wait complete. 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 Processor -- start 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- start start 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 0x7fd85c060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 0x7fd85c060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c061180 0x7fd85c163290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1637d0 con 0x7fd85c10cfb0 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c163940 con 0x7fd85c1131c0 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c163b00 con 0x7fd85c061180 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 0x7fd85c060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:38.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 0x7fd85c060700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44670/0 (socket says 10.20.193.91:44670) 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 -- 10.20.193.91:0/3953156812 learned_addr learned my addr 10.20.193.91:0/3953156812 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd861e616c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c061180 0x7fd85c163290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd860e5f6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 0x7fd85c060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 -- 10.20.193.91:0/3953156812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c061180 msgr2=0x7fd85c163290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c061180 0x7fd85c163290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 -- 10.20.193.91:0/3953156812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 msgr2=0x7fd85c060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 0x7fd85c060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 -- 10.20.193.91:0/3953156812 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd850009590 con 0x7fd85c10cfb0 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd861e616c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c061180 0x7fd85c163290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd860e5f6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 0x7fd85c060c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8616606c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 0x7fd85c060700 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd84c005dc0 tx=0x7fd84c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:38.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd84c004250 con 0x7fd85c10cfb0 2026-02-13T01:28:38.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c163de0 con 0x7fd85c10cfb0 2026-02-13T01:28:38.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd84c009070 con 0x7fd85c10cfb0 2026-02-13T01:28:38.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.749+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd84c00cd70 con 0x7fd85c10cfb0 2026-02-13T01:28:38.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.750+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c164270 con 0x7fd85c10cfb0 2026-02-13T01:28:38.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.750+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c10e280 con 0x7fd85c10cfb0 2026-02-13T01:28:38.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.751+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd84c0028c0 con 0x7fd85c10cfb0 2026-02-13T01:28:38.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.752+0000 7fd84a7fc6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd8380b5650 0x7fd8380d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:38.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.752+0000 7fd860e5f6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd8380b5650 0x7fd8380d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:38.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.752+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fd84c0e3be0 con 0x7fd85c10cfb0 2026-02-13T01:28:38.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.752+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd84c0a65c0 con 0x7fd85c10cfb0 2026-02-13T01:28:38.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.752+0000 7fd860e5f6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd8380b5650 0x7fd8380d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd85c10faa0 tx=0x7fd8500023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:38.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.866+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd85c10d380 con 0x7fd85c10cfb0 2026-02-13T01:28:38.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.866+0000 7fd84a7fc6c0 1 -- 10.20.193.91:0/3953156812 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd84c0a9770 con 0x7fd85c10cfb0 2026-02-13T01:28:38.867 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:38.867 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:38.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd8380b5650 msgr2=0x7fd8380d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:38.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd8380b5650 0x7fd8380d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd85c10faa0 tx=0x7fd8500023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 msgr2=0x7fd85c060700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 0x7fd85c060700 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd84c005dc0 tx=0x7fd84c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 shutdown_connections 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd8380b5650 0x7fd8380d5b00 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd85c061180 0x7fd85c163290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd85c1131c0 0x7fd85c060c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 --2- 10.20.193.91:0/3953156812 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd85c10cfb0 0x7fd85c060700 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 >> 10.20.193.91:0/3953156812 conn(0x7fd85c0ea8b0 msgr2=0x7fd85c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 shutdown_connections 2026-02-13T01:28:38.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:38.867+0000 7fd8638ef6c0 1 -- 10.20.193.91:0/3953156812 wait complete. 2026-02-13T01:28:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:39 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3953156812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:39.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:39 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3953156812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:39.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:39 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3953156812' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:40.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:40 trial126 ceph-mon[26569]: pgmap v285: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:40.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:40 trial154 ceph-mon[27045]: pgmap v285: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:40.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:40 trial091 ceph-mon[25068]: pgmap v285: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:41.908 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:42.027 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:42.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- 10.20.193.91:0/3809532950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410fc20 msgr2=0x7fb5c4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/3809532950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410fc20 0x7fb5c4114c60 secure :-1 s=READY pgs=419 gs=3 cs=0 l=1 c_cookie=10375238309668488147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5ac0099a0 tx=0x7fb5ac02ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:42.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- 10.20.193.91:0/3809532950 shutdown_connections 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/3809532950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5c4115440 0x7fb5c4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/3809532950 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410fc20 0x7fb5c4114c60 unknown :-1 s=CLOSED pgs=419 gs=3 cs=0 l=1 c_cookie=10375238309668488147 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/3809532950 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5c410f230 0x7fb5c410f600 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- 10.20.193.91:0/3809532950 >> 10.20.193.91:0/3809532950 conn(0x7fb5c40ecb30 msgr2=0x7fb5c410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- 10.20.193.91:0/3809532950 shutdown_connections 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- 10.20.193.91:0/3809532950 wait complete. 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 Processor -- start 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- start start 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 0x7fb5c40f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5c4115440 0x7fb5c4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5c40f52c0 0x7fb5c40fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40f59b0 con 0x7fb5c410f230 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40faa80 con 0x7fb5c40f52c0 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c96416c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40fac40 con 0x7fb5c4115440 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 0x7fb5c40f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 0x7fb5c40f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44694/0 (socket says 10.20.193.91:44694) 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 -- 10.20.193.91:0/2260232618 learned_addr learned my addr 10.20.193.91:0/2260232618 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c27fc6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5c4115440 0x7fb5c4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 -- 10.20.193.91:0/2260232618 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5c4115440 msgr2=0x7fb5c4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5c4115440 0x7fb5c4175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 -- 10.20.193.91:0/2260232618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5c40f52c0 msgr2=0x7fb5c40fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5c40f52c0 0x7fb5c40fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.139+0000 7fb5c2ffd6c0 1 -- 10.20.193.91:0/2260232618 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac009590 con 0x7fb5c410f230 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5c2ffd6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 0x7fb5c40f4c90 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5b8009490 tx=0x7fb5b800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5b8004a80 con 0x7fb5c410f230 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb5b8009030 con 0x7fb5c410f230 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c40faf20 con 0x7fb5c410f230 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5b800cdd0 con 0x7fb5c410f230 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c40fb3b0 con 0x7fb5c410f230 2026-02-13T01:28:42.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.140+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c4110500 con 0x7fb5c410f230 2026-02-13T01:28:42.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.141+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb5b80026b0 con 0x7fb5c410f230 2026-02-13T01:28:42.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.142+0000 7fb5a3fff6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5980b5650 0x7fb5980d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:42.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.142+0000 7fb5c27fc6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5980b5650 0x7fb5980d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:42.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.142+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fb5b80e3a40 con 0x7fb5c410f230 2026-02-13T01:28:42.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.143+0000 7fb5c27fc6c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5980b5650 0x7fb5980d5b00 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5c40fb5d0 tx=0x7fb5ac0023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:42.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.143+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5b80a63e0 con 0x7fb5c410f230 2026-02-13T01:28:42.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.261+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb5c410f600 con 0x7fb5c410f230 2026-02-13T01:28:42.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.261+0000 7fb5a3fff6c0 1 -- 10.20.193.91:0/2260232618 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb5b80a9590 con 0x7fb5c410f230 2026-02-13T01:28:42.262 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:42.262 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5980b5650 msgr2=0x7fb5980d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5980b5650 0x7fb5980d5b00 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5c40fb5d0 tx=0x7fb5ac0023a0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 msgr2=0x7fb5c40f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 0x7fb5c40f4c90 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5b8009490 tx=0x7fb5b800bc50 comp rx=0 tx=0).stop 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 shutdown_connections 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb5980b5650 0x7fb5980d5b00 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5c40f52c0 0x7fb5c40fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb5c4115440 0x7fb5c4175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 --2- 10.20.193.91:0/2260232618 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb5c410f230 0x7fb5c40f4c90 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:42.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 >> 10.20.193.91:0/2260232618 conn(0x7fb5c40ecb30 msgr2=0x7fb5c410d890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:42.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 shutdown_connections 2026-02-13T01:28:42.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:42.262+0000 7fb5c96416c0 1 -- 10.20.193.91:0/2260232618 wait complete. 2026-02-13T01:28:42.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:42 trial126 ceph-mon[26569]: pgmap v286: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:42.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:42 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2260232618' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:42.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:42 trial154 ceph-mon[27045]: pgmap v286: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:42.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:42 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2260232618' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:42.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:42 trial091 ceph-mon[25068]: pgmap v286: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:42.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:42 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2260232618' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:44.531 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:44 trial091 ceph-mon[25068]: pgmap v287: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:44.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:44 trial126 ceph-mon[26569]: pgmap v287: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:44.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:44 trial154 ceph-mon[27045]: pgmap v287: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:45.303 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:45.425 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:45.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 -- 10.20.193.91:0/1514972069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c10fbf0 msgr2=0x7f1b2c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:45.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 --2- 10.20.193.91:0/1514972069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c10fbf0 0x7f1b2c114c30 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=2539571103372581172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b200099a0 tx=0x7f1b2002ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:45.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 -- 10.20.193.91:0/1514972069 shutdown_connections 2026-02-13T01:28:45.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 --2- 10.20.193.91:0/1514972069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b2c115410 0x7f1b2c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 --2- 10.20.193.91:0/1514972069 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c10fbf0 0x7f1b2c114c30 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=2539571103372581172 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 --2- 10.20.193.91:0/1514972069 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b2c10f200 0x7f1b2c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 -- 10.20.193.91:0/1514972069 >> 10.20.193.91:0/1514972069 conn(0x7f1b2c0ecb00 msgr2=0x7f1b2c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 -- 10.20.193.91:0/1514972069 shutdown_connections 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.538+0000 7f1b344036c0 1 -- 10.20.193.91:0/1514972069 wait complete. 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 Processor -- start 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 -- start start 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b2c10f200 0x7f1b2c0f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b2c115410 0x7f1b2c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 0x7f1b2c0fa5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c0f5a10 con 0x7f1b2c0f5320 2026-02-13T01:28:45.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c0faae0 con 0x7f1b2c10f200 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c0faca0 con 0x7f1b2c115410 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 0x7f1b2c0fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 0x7f1b2c0fa5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:44706/0 (socket says 10.20.193.91:44706) 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 -- 10.20.193.91:0/3296805092 learned_addr learned my addr 10.20.193.91:0/3296805092 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b321746c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b2c10f200 0x7f1b2c0f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b319736c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b2c115410 0x7f1b2c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 -- 10.20.193.91:0/3296805092 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b2c115410 msgr2=0x7f1b2c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b2c115410 0x7f1b2c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 -- 10.20.193.91:0/3296805092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b2c10f200 msgr2=0x7f1b2c0f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b2c10f200 0x7f1b2c0f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 -- 10.20.193.91:0/3296805092 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b20009590 con 0x7f1b2c0f5320 2026-02-13T01:28:45.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b329756c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 0x7f1b2c0fa5a0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b28006ea0 tx=0x7f1b2800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b28003c40 con 0x7f1b2c0f5320 2026-02-13T01:28:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1b28003da0 con 0x7f1b2c0f5320 2026-02-13T01:28:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2c0faf80 con 0x7f1b2c0f5320 2026-02-13T01:28:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b280081c0 con 0x7f1b2c0f5320 2026-02-13T01:28:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.539+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2c0fb710 con 0x7f1b2c0f5320 2026-02-13T01:28:45.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.540+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2c1104d0 con 0x7f1b2c0f5320 2026-02-13T01:28:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.541+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1b28005860 con 0x7f1b2c0f5320 2026-02-13T01:28:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.542+0000 7f1b137fe6c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b080b56d0 0x7f1b080d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.542+0000 7f1b321746c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b080b56d0 0x7f1b080d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.542+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f1b280e4a50 con 0x7f1b2c0f5320 2026-02-13T01:28:45.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.542+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1b2811d5e0 con 0x7f1b2c0f5320 2026-02-13T01:28:45.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.542+0000 7f1b321746c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b080b56d0 0x7f1b080d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b1c004750 tx=0x7f1b1c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.657+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b2c0f5df0 con 0x7f1b2c0f5320 2026-02-13T01:28:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.657+0000 7f1b137fe6c0 1 -- 10.20.193.91:0/3296805092 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1b280a73f0 con 0x7f1b2c0f5320 2026-02-13T01:28:45.659 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:45.659 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b080b56d0 msgr2=0x7f1b080d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b080b56d0 0x7f1b080d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b1c004750 tx=0x7f1b1c009260 comp rx=0 tx=0).stop 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 msgr2=0x7f1b2c0fa5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 0x7f1b2c0fa5a0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b28006ea0 tx=0x7f1b2800ce50 comp rx=0 tx=0).stop 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 shutdown_connections 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1b080b56d0 0x7f1b080d5b80 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1b2c0f5320 0x7f1b2c0fa5a0 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1b2c115410 0x7f1b2c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 --2- 10.20.193.91:0/3296805092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b2c10f200 0x7f1b2c0f4cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 >> 10.20.193.91:0/3296805092 conn(0x7f1b2c0ecb00 msgr2=0x7f1b2c111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:45.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 shutdown_connections 2026-02-13T01:28:45.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:45.659+0000 7f1b344036c0 1 -- 10.20.193.91:0/3296805092 wait complete. 2026-02-13T01:28:46.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:46 trial126 ceph-mon[26569]: pgmap v288: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:46.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:46 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3296805092' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:46.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:46 trial154 ceph-mon[27045]: pgmap v288: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:46.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:46 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3296805092' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:46.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:46 trial091 ceph-mon[25068]: pgmap v288: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:46.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:46 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3296805092' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:48.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:48 trial126 ceph-mon[26569]: pgmap v289: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:48.702 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:48.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:48 trial154 ceph-mon[27045]: pgmap v289: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:48.726 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:48 trial091 ceph-mon[25068]: pgmap v289: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:48.821 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 -- 10.20.193.91:0/1336642250 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c1149f0 msgr2=0x7f041c1181b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 --2- 10.20.193.91:0/1336642250 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c1149f0 0x7f041c1181b0 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=8590478164634162157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04100099a0 tx=0x7f041002ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 -- 10.20.193.91:0/1336642250 shutdown_connections 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 --2- 10.20.193.91:0/1336642250 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f041c118940 0x7f041c17c550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 --2- 10.20.193.91:0/1336642250 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c1149f0 0x7f041c1181b0 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=8590478164634162157 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 --2- 10.20.193.91:0/1336642250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f041c114000 0x7f041c1143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 -- 10.20.193.91:0/1336642250 >> 10.20.193.91:0/1336642250 conn(0x7f041c05c880 msgr2=0x7f041c058b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 -- 10.20.193.91:0/1336642250 shutdown_connections 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.938+0000 7f04237706c0 1 -- 10.20.193.91:0/1336642250 wait complete. 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 Processor -- start 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 -- start start 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 0x7f041c123b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f041c118940 0x7f041c124050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f041c129410 0x7f041c1298b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f041c129e20 con 0x7f041c114000 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f041c129f90 con 0x7f041c118940 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f041c12a150 con 0x7f041c129410 2026-02-13T01:28:48.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 0x7f041c123b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 0x7f041c123b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48536/0 (socket says 10.20.193.91:48536) 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 -- 10.20.193.91:0/4027286831 learned_addr learned my addr 10.20.193.91:0/4027286831 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f0421ce26c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f041c129410 0x7f041c1298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f0420ce06c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f041c118940 0x7f041c124050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 -- 10.20.193.91:0/4027286831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f041c129410 msgr2=0x7f041c1298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f041c129410 0x7f041c1298b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 -- 10.20.193.91:0/4027286831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f041c118940 msgr2=0x7f041c124050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f041c118940 0x7f041c124050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 -- 10.20.193.91:0/4027286831 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0410009590 con 0x7f041c114000 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04214e16c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 0x7f041c123b10 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c00b710 tx=0x7f040c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f040c004250 con 0x7f041c114000 2026-02-13T01:28:48.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f040c002d80 con 0x7f041c114000 2026-02-13T01:28:48.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c16a600 con 0x7f041c114000 2026-02-13T01:28:48.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f040c00cdc0 con 0x7f041c114000 2026-02-13T01:28:48.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.939+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c16aae0 con 0x7f041c114000 2026-02-13T01:28:48.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.940+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c056480 con 0x7f041c114000 2026-02-13T01:28:48.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.941+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f040c0028c0 con 0x7f041c114000 2026-02-13T01:28:48.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.942+0000 7f040a7fc6c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03f80b56d0 0x7f03f80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:48.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.942+0000 7f0420ce06c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03f80b56d0 0x7f03f80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:48.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.942+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f040c0e3cd0 con 0x7f041c114000 2026-02-13T01:28:48.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.942+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f040c0a9640 con 0x7f041c114000 2026-02-13T01:28:48.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:48.942+0000 7f0420ce06c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03f80b56d0 0x7f03f80d5b80 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0410005b40 tx=0x7f0410005c20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:49.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.056+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f041c1143d0 con 0x7f041c114000 2026-02-13T01:28:49.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.056+0000 7f040a7fc6c0 1 -- 10.20.193.91:0/4027286831 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f040c0a9820 con 0x7f041c114000 2026-02-13T01:28:49.057 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:49.057 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03f80b56d0 msgr2=0x7f03f80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03f80b56d0 0x7f03f80d5b80 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0410005b40 tx=0x7f0410005c20 comp rx=0 tx=0).stop 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 msgr2=0x7f041c123b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 0x7f041c123b10 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c00b710 tx=0x7f040c00bbe0 comp rx=0 tx=0).stop 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 shutdown_connections 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f03f80b56d0 0x7f03f80d5b80 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f041c129410 0x7f041c1298b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f041c118940 0x7f041c124050 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:49.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 --2- 10.20.193.91:0/4027286831 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f041c114000 0x7f041c123b10 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:49.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 >> 10.20.193.91:0/4027286831 conn(0x7f041c05c880 msgr2=0x7f041c1171a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:49.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 shutdown_connections 2026-02-13T01:28:49.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:49.057+0000 7f04237706c0 1 -- 10.20.193.91:0/4027286831 wait complete. 2026-02-13T01:28:49.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:49 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4027286831' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:49 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4027286831' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:49.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:49 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4027286831' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:50 trial126 ceph-mon[26569]: pgmap v290: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:50.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:50 trial154 ceph-mon[27045]: pgmap v290: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:50.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:50 trial091 ceph-mon[25068]: pgmap v290: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:28:52.098 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:52.215 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:52.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- 10.20.193.91:0/3896963916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc115440 msgr2=0x7fa8fc175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:52.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- 10.20.193.91:0/3896963916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc115440 0x7fa8fc175de0 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=3931648556241710228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f000aa70 tx=0x7fa8f002fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- 10.20.193.91:0/3896963916 shutdown_connections 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- 10.20.193.91:0/3896963916 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc115440 0x7fa8fc175de0 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=3931648556241710228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- 10.20.193.91:0/3896963916 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa8fc10fc20 0x7fa8fc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- 10.20.193.91:0/3896963916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa8fc10f230 0x7fa8fc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- 10.20.193.91:0/3896963916 >> 10.20.193.91:0/3896963916 conn(0x7fa8fc0ecb30 msgr2=0x7fa8fc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- 10.20.193.91:0/3896963916 shutdown_connections 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- 10.20.193.91:0/3896963916 wait complete. 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 Processor -- start 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- start start 2026-02-13T01:28:52.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa8fc10f230 0x7fa8fc11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa8fc115440 0x7fa8fc11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 0x7fa8fc122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc1234f0 con 0x7fa8fc122ae0 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc123660 con 0x7fa8fc115440 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.328+0000 7fa9049776c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc123820 con 0x7fa8fc10f230 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 0x7fa8fc122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 0x7fa8fc122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48556/0 (socket says 10.20.193.91:48556) 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 -- 10.20.193.91:0/4289638462 learned_addr learned my addr 10.20.193.91:0/4289638462 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa901ee76c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa8fc115440 0x7fa8fc11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa9026e86c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa8fc10f230 0x7fa8fc11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 -- 10.20.193.91:0/4289638462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa8fc10f230 msgr2=0x7fa8fc11d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:52.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa8fc10f230 0x7fa8fc11d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 -- 10.20.193.91:0/4289638462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa8fc115440 msgr2=0x7fa8fc11d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa8fc115440 0x7fa8fc11d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 -- 10.20.193.91:0/4289638462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f000a660 con 0x7fa8fc122ae0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa902ee96c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 0x7fa8fc122f80 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f00054b0 tx=0x7fa8f00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8f0003a30 con 0x7fa8fc122ae0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8fc163c70 con 0x7fa8fc122ae0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa8f0003b90 con 0x7fa8fc122ae0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8f00382f0 con 0x7fa8fc122ae0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.329+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8fc1640a0 con 0x7fa8fc122ae0 2026-02-13T01:28:52.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.330+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc110500 con 0x7fa8fc122ae0 2026-02-13T01:28:52.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.331+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa8f0008260 con 0x7fa8fc122ae0 2026-02-13T01:28:52.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.331+0000 7fa8e77fe6c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa8d80b5650 0x7fa8d80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:52.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.331+0000 7fa9026e86c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa8d80b5650 0x7fa8d80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:52.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.331+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fa8f0108f40 con 0x7fa8fc122ae0 2026-02-13T01:28:52.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.331+0000 7fa9026e86c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa8d80b5650 0x7fa8d80d5b00 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f4005980 tx=0x7fa8f4005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:52.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.332+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa8f00cb8e0 con 0x7fa8fc122ae0 2026-02-13T01:28:52.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.449+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa8fc11e330 con 0x7fa8fc122ae0 2026-02-13T01:28:52.449 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:52 trial091 ceph-mon[25068]: pgmap v291: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:52.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.449+0000 7fa8e77fe6c0 1 -- 10.20.193.91:0/4289638462 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa8f00cea90 con 0x7fa8fc122ae0 2026-02-13T01:28:52.450 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:52.450 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.450+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa8d80b5650 msgr2=0x7fa8d80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.450+0000 7fa9049776c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa8d80b5650 0x7fa8d80d5b00 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f4005980 tx=0x7fa8f4005910 comp rx=0 tx=0).stop 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.450+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 msgr2=0x7fa8fc122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.450+0000 7fa9049776c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 0x7fa8fc122f80 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f00054b0 tx=0x7fa8f00054e0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 shutdown_connections 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fa8d80b5650 0x7fa8d80d5b00 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fa8fc122ae0 0x7fa8fc122f80 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa8fc115440 0x7fa8fc11d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 --2- 10.20.193.91:0/4289638462 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fa8fc10f230 0x7fa8fc11d1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:52.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 >> 10.20.193.91:0/4289638462 conn(0x7fa8fc0ecb30 msgr2=0x7fa8fc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:52.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 shutdown_connections 2026-02-13T01:28:52.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:52.451+0000 7fa9049776c0 1 -- 10.20.193.91:0/4289638462 wait complete. 2026-02-13T01:28:52.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:52 trial126 ceph-mon[26569]: pgmap v291: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:52.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:52 trial154 ceph-mon[27045]: pgmap v291: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:53 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4289638462' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:53.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:53 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4289638462' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:53.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:53 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4289638462' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:54.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:54 trial126 ceph-mon[26569]: pgmap v292: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:54.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:54 trial154 ceph-mon[27045]: pgmap v292: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:54.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:54 trial091 ceph-mon[25068]: pgmap v292: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:28:55.492 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:55.615 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:55.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- 10.20.193.91:0/776302231 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d810fbf0 msgr2=0x7f77d8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- 10.20.193.91:0/776302231 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d810fbf0 0x7f77d8114c30 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=12146886444006121724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77c00099a0 tx=0x7f77c002ed20 comp rx=0 tx=0).stop 2026-02-13T01:28:55.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- 10.20.193.91:0/776302231 shutdown_connections 2026-02-13T01:28:55.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- 10.20.193.91:0/776302231 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77d8115410 0x7f77d8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- 10.20.193.91:0/776302231 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d810fbf0 0x7f77d8114c30 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=12146886444006121724 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- 10.20.193.91:0/776302231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77d810f200 0x7f77d810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- 10.20.193.91:0/776302231 >> 10.20.193.91:0/776302231 conn(0x7f77d80ecb00 msgr2=0x7f77d810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:55.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- 10.20.193.91:0/776302231 shutdown_connections 2026-02-13T01:28:55.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- 10.20.193.91:0/776302231 wait complete. 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 Processor -- start 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- start start 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77d810f200 0x7f77d80f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 0x7f77d8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77d80f52c0 0x7f77d80fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80f59b0 con 0x7f77d8115410 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80faad0 con 0x7f77d80f52c0 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77dce756c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80fac90 con 0x7f77d810f200 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77d5d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 0x7f77d8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77d5d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 0x7f77d8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48570/0 (socket says 10.20.193.91:48570) 2026-02-13T01:28:55.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.728+0000 7f77d5d746c0 1 -- 10.20.193.91:0/4003483902 learned_addr learned my addr 10.20.193.91:0/4003483902 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77d5d746c0 1 -- 10.20.193.91:0/4003483902 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77d810f200 msgr2=0x7f77d80f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77d5d746c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77d810f200 0x7f77d80f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77d5d746c0 1 -- 10.20.193.91:0/4003483902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77d80f52c0 msgr2=0x7f77d80fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77d5d746c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77d80f52c0 0x7f77d80fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77d5d746c0 1 -- 10.20.193.91:0/4003483902 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c0009590 con 0x7f77d8115410 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77d5d746c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 0x7f77d8175cb0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77c0004830 tx=0x7f77c002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77c0002ae0 con 0x7f77d8115410 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f77c0002c40 con 0x7f77d8115410 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d80faf10 con 0x7f77d8115410 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77c00362f0 con 0x7f77d8115410 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d80fb3b0 con 0x7f77d8115410 2026-02-13T01:28:55.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.729+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d81104d0 con 0x7f77d8115410 2026-02-13T01:28:55.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.730+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f77c0007810 con 0x7f77d8115410 2026-02-13T01:28:55.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.731+0000 7f77bf7fe6c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b00b56d0 0x7f77b00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:55.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.731+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f77c0107ce0 con 0x7f77d8115410 2026-02-13T01:28:55.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.731+0000 7f77d65756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b00b56d0 0x7f77b00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:55.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.731+0000 7f77d65756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b00b56d0 0x7f77b00d5b80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77cc004750 tx=0x7f77cc005cb0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:55.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.731+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77c00ca680 con 0x7f77d8115410 2026-02-13T01:28:55.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.849+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f77d810fbf0 con 0x7f77d8115410 2026-02-13T01:28:55.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.850+0000 7f77bf7fe6c0 1 -- 10.20.193.91:0/4003483902 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f77c00cd830 con 0x7f77d8115410 2026-02-13T01:28:55.849 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:55.850 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b00b56d0 msgr2=0x7f77b00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b00b56d0 0x7f77b00d5b80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77cc004750 tx=0x7f77cc005cb0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 msgr2=0x7f77d8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 0x7f77d8175cb0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77c0004830 tx=0x7f77c002fbf0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 shutdown_connections 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f77b00b56d0 0x7f77b00d5b80 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f77d80f52c0 0x7f77d80fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f77d8115410 0x7f77d8175cb0 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 --2- 10.20.193.91:0/4003483902 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f77d810f200 0x7f77d80f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:55.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 >> 10.20.193.91:0/4003483902 conn(0x7f77d80ecb00 msgr2=0x7f77d8113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:55.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 shutdown_connections 2026-02-13T01:28:55.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:55.851+0000 7f77dce756c0 1 -- 10.20.193.91:0/4003483902 wait complete. 2026-02-13T01:28:56.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:56 trial126 ceph-mon[26569]: pgmap v293: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:56.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:56 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4003483902' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:56.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:56 trial154 ceph-mon[27045]: pgmap v293: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:56.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:56 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4003483902' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:56.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:56 trial091 ceph-mon[25068]: pgmap v293: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:56.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:56 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4003483902' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:58.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:58 trial126 ceph-mon[26569]: pgmap v294: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:58.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:58 trial154 ceph-mon[27045]: pgmap v294: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:58.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:58 trial091 ceph-mon[25068]: pgmap v294: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:28:58.894 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:28:59.012 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:28:59.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 -- 10.20.193.91:0/669686456 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 msgr2=0x7f1770175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:59.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 --2- 10.20.193.91:0/669686456 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f1770175db0 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=11652965022749147819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f176c00aa70 tx=0x7f176c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 -- 10.20.193.91:0/669686456 shutdown_connections 2026-02-13T01:28:59.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 --2- 10.20.193.91:0/669686456 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f1770175db0 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=11652965022749147819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 --2- 10.20.193.91:0/669686456 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f177010fbf0 0x7f1770114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 --2- 10.20.193.91:0/669686456 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f177010f200 0x7f177010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 -- 10.20.193.91:0/669686456 >> 10.20.193.91:0/669686456 conn(0x7f17700ecb00 msgr2=0x7f177010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 -- 10.20.193.91:0/669686456 shutdown_connections 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.125+0000 7f17775f86c0 1 -- 10.20.193.91:0/669686456 wait complete. 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 Processor -- start 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 -- start start 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f177010f200 0x7f177011d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f177011d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1770122b00 0x7f1770122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1770123510 con 0x7f1770115410 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1770123680 con 0x7f1770122b00 2026-02-13T01:28:59.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1770123840 con 0x7f177010f200 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f177011d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f177011d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37692/0 (socket says 10.20.193.91:37692) 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 -- 10.20.193.91:0/645450005 learned_addr learned my addr 10.20.193.91:0/645450005 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f177536d6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f177010f200 0x7f177011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1775b6e6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1770122b00 0x7f1770122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 -- 10.20.193.91:0/645450005 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f177010f200 msgr2=0x7f177011d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f177010f200 0x7f177011d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 -- 10.20.193.91:0/645450005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1770122b00 msgr2=0x7f1770122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1770122b00 0x7f1770122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 -- 10.20.193.91:0/645450005 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c00a660 con 0x7f1770115410 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1775b6e6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1770122b00 0x7f1770122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:28:59.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f1774b6c6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f177011d740 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1764005dc0 tx=0x7f176400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:59.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1764004250 con 0x7f1770115410 2026-02-13T01:28:59.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1770163cf0 con 0x7f1770115410 2026-02-13T01:28:59.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1764009070 con 0x7f1770115410 2026-02-13T01:28:59.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f176400cd50 con 0x7f1770115410 2026-02-13T01:28:59.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.126+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1770164180 con 0x7f1770115410 2026-02-13T01:28:59.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.127+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17701104d0 con 0x7f1770115410 2026-02-13T01:28:59.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.128+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f17640028c0 con 0x7f1770115410 2026-02-13T01:28:59.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.128+0000 7f175e7fc6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f174c0b5650 0x7f174c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:28:59.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.129+0000 7f177536d6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f174c0b5650 0x7f174c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:28:59.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.129+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f17640e3ca0 con 0x7f1770115410 2026-02-13T01:28:59.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.129+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f17640a6640 con 0x7f1770115410 2026-02-13T01:28:59.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.129+0000 7f177536d6c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f174c0b5650 0x7f174c0d5b00 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1760005980 tx=0x7f1760005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:28:59.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.243+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f177011e350 con 0x7f1770115410 2026-02-13T01:28:59.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.243+0000 7f175e7fc6c0 1 -- 10.20.193.91:0/645450005 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f17640a97f0 con 0x7f1770115410 2026-02-13T01:28:59.243 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:28:59.243 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:28:59.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f174c0b5650 msgr2=0x7f174c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:59.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f174c0b5650 0x7f174c0d5b00 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1760005980 tx=0x7f1760005910 comp rx=0 tx=0).stop 2026-02-13T01:28:59.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 msgr2=0x7f177011d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f177011d740 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1764005dc0 tx=0x7f176400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 shutdown_connections 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f174c0b5650 0x7f174c0d5b00 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1770122b00 0x7f1770122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1770115410 0x7f177011d740 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 --2- 10.20.193.91:0/645450005 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f177010f200 0x7f177011d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 >> 10.20.193.91:0/645450005 conn(0x7f17700ecb00 msgr2=0x7f177010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 shutdown_connections 2026-02-13T01:28:59.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:28:59.244+0000 7f17775f86c0 1 -- 10.20.193.91:0/645450005 wait complete. 2026-02-13T01:28:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:28:59 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/645450005' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:28:59 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/645450005' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:28:59.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:28:59 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/645450005' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:00.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:00 trial126 ceph-mon[26569]: pgmap v295: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:00.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:00 trial154 ceph-mon[27045]: pgmap v295: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:00.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:00 trial091 ceph-mon[25068]: pgmap v295: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:02.284 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:02.404 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:02.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.526+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/2372925547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b4410f230 msgr2=0x7f2b4410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.526+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/2372925547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b4410f230 0x7f2b4410f600 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=12744342815656895464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b300099a0 tx=0x7f2b3002ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:02.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/2372925547 shutdown_connections 2026-02-13T01:29:02.528 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/2372925547 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 0x7f2b44175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/2372925547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b4410fc20 0x7f2b44114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/2372925547 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b4410f230 0x7f2b4410f600 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=12744342815656895464 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/2372925547 >> 10.20.193.91:0/2372925547 conn(0x7f2b440ecb30 msgr2=0x7f2b4410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/2372925547 shutdown_connections 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/2372925547 wait complete. 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 Processor -- start 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- start start 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b4410f230 0x7f2b4411d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 0x7f2b4411d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 0x7f2b44123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441236c0 con 0x7f2b44122cb0 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44123830 con 0x7f2b4410f230 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b4a84d6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441239f0 con 0x7f2b44115440 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 0x7f2b44123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 0x7f2b44123150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37714/0 (socket says 10.20.193.91:37714) 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 -- 10.20.193.91:0/898714604 learned_addr learned my addr 10.20.193.91:0/898714604 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b43fff6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b4410f230 0x7f2b4411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b437fe6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 0x7f2b4411d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 -- 10.20.193.91:0/898714604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 msgr2=0x7f2b4411d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 0x7f2b4411d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 -- 10.20.193.91:0/898714604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b4410f230 msgr2=0x7f2b4411d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b4410f230 0x7f2b4411d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b48dbf6c0 1 -- 10.20.193.91:0/898714604 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b30009590 con 0x7f2b44122cb0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.527+0000 7f2b437fe6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 0x7f2b4411d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b48dbf6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 0x7f2b44123150 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b38006ea0 tx=0x7f2b3800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b38003a30 con 0x7f2b44122cb0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2b380054f0 con 0x7f2b44122cb0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b44163ea0 con 0x7f2b44122cb0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b3800dcd0 con 0x7f2b44122cb0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b44164330 con 0x7f2b44122cb0 2026-02-13T01:29:02.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.528+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b44110500 con 0x7f2b44122cb0 2026-02-13T01:29:02.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.529+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2b38005030 con 0x7f2b44122cb0 2026-02-13T01:29:02.532 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.530+0000 7f2b417fa6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b180b56d0 0x7f2b180d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:02.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.530+0000 7f2b43fff6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b180b56d0 0x7f2b180d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:02.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.530+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f2b380e4cd0 con 0x7f2b44122cb0 2026-02-13T01:29:02.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.530+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b380a7670 con 0x7f2b44122cb0 2026-02-13T01:29:02.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.530+0000 7f2b43fff6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b180b56d0 0x7f2b180d5b80 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b300023e0 tx=0x7f2b3002f580 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:02.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:02 trial126 ceph-mon[26569]: pgmap v296: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:02.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.647+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2b4410f600 con 0x7f2b44122cb0 2026-02-13T01:29:02.648 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:02 trial091 ceph-mon[25068]: pgmap v296: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:02.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.648+0000 7f2b417fa6c0 1 -- 10.20.193.91:0/898714604 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2b380aa820 con 0x7f2b44122cb0 2026-02-13T01:29:02.648 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:02.649 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b180b56d0 msgr2=0x7f2b180d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b180b56d0 0x7f2b180d5b80 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b300023e0 tx=0x7f2b3002f580 comp rx=0 tx=0).stop 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 msgr2=0x7f2b44123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 0x7f2b44123150 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b38006ea0 tx=0x7f2b3800cca0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 shutdown_connections 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f2b180b56d0 0x7f2b180d5b80 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f2b44122cb0 0x7f2b44123150 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f2b44115440 0x7f2b4411d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 --2- 10.20.193.91:0/898714604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b4410f230 0x7f2b4411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:02.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 >> 10.20.193.91:0/898714604 conn(0x7f2b440ecb30 msgr2=0x7f2b4410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:02.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 shutdown_connections 2026-02-13T01:29:02.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:02.649+0000 7f2b4a84d6c0 1 -- 10.20.193.91:0/898714604 wait complete. 2026-02-13T01:29:02.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:02 trial154 ceph-mon[27045]: pgmap v296: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:03.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:03 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/898714604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:03.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:03 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/898714604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:03.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:03 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/898714604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:04.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:04 trial126 ceph-mon[26569]: pgmap v297: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:04.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:04 trial154 ceph-mon[27045]: pgmap v297: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:04.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:04 trial091 ceph-mon[25068]: pgmap v297: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:05.688 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:05.808 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:05.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/478374271 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c0010cf80 msgr2=0x7f7c0010d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:05.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/478374271 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c0010cf80 0x7f7c0010d350 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=12004589769715924508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bec0099a0 tx=0x7f7bec02ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:05.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/478374271 shutdown_connections 2026-02-13T01:29:05.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/478374271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c00113190 0x7f7c00173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:05.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/478374271 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c0010d970 0x7f7c001129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/478374271 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c0010cf80 0x7f7c0010d350 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=12004589769715924508 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/478374271 >> 10.20.193.91:0/478374271 conn(0x7f7c000ea880 msgr2=0x7f7c0010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/478374271 shutdown_connections 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/478374271 wait complete. 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 Processor -- start 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.921+0000 7f7c05cb16c0 1 -- start start 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c0010cf80 0x7f7c0011afe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 0x7f7c0011b520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c001208e0 0x7f7c00120d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7c001212f0 con 0x7f7c00113190 2026-02-13T01:29:05.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00121460 con 0x7f7c0010cf80 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7c00121620 con 0x7f7c001208e0 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 0x7f7c0011b520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 0x7f7c0011b520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:37740/0 (socket says 10.20.193.91:37740) 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 -- 10.20.193.91:0/3464163764 learned_addr learned my addr 10.20.193.91:0/3464163764 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bff7fe6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c0010cf80 0x7f7c0011afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfffff6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c001208e0 0x7f7c00120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 -- 10.20.193.91:0/3464163764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c001208e0 msgr2=0x7f7c00120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c001208e0 0x7f7c00120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 -- 10.20.193.91:0/3464163764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c0010cf80 msgr2=0x7f7c0011afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c0010cf80 0x7f7c0011afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 -- 10.20.193.91:0/3464163764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec009590 con 0x7f7c00113190 2026-02-13T01:29:05.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bff7fe6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c0010cf80 0x7f7c0011afe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfeffd6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 0x7f7c0011b520 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bf000b6c0 tx=0x7f7bf000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bf0004250 con 0x7f7c00113190 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bf0009070 con 0x7f7c00113190 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c00161ad0 con 0x7f7c00113190 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bf000ccb0 con 0x7f7c00113190 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c00161f60 con 0x7f7c00113190 2026-02-13T01:29:05.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.922+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0010e250 con 0x7f7c00113190 2026-02-13T01:29:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.924+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7bf00028c0 con 0x7f7c00113190 2026-02-13T01:29:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.924+0000 7f7bfcff96c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7bd40b56d0 0x7f7bd40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:05.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.924+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7bf00e3bf0 con 0x7f7c00113190 2026-02-13T01:29:05.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.924+0000 7f7bff7fe6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7bd40b56d0 0x7f7bd40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:05.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.925+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7bf00a65d0 con 0x7f7c00113190 2026-02-13T01:29:05.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:05.925+0000 7f7bff7fe6c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7bd40b56d0 0x7f7bd40d5b80 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bec005d10 tx=0x7f7bec005ca0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:06.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.039+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7c0010d350 con 0x7f7c00113190 2026-02-13T01:29:06.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.039+0000 7f7bfcff96c0 1 -- 10.20.193.91:0/3464163764 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7bf00a9780 con 0x7f7c00113190 2026-02-13T01:29:06.039 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:06.039 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7bd40b56d0 msgr2=0x7f7bd40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7bd40b56d0 0x7f7bd40d5b80 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bec005d10 tx=0x7f7bec005ca0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 msgr2=0x7f7c0011b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 0x7f7c0011b520 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bf000b6c0 tx=0x7f7bf000bb90 comp rx=0 tx=0).stop 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 shutdown_connections 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7bd40b56d0 0x7f7bd40d5b80 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7c001208e0 0x7f7c00120d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7c00113190 0x7f7c0011b520 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 --2- 10.20.193.91:0/3464163764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7c0010cf80 0x7f7c0011afe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:06.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 >> 10.20.193.91:0/3464163764 conn(0x7f7c000ea880 msgr2=0x7f7c0010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:06.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 shutdown_connections 2026-02-13T01:29:06.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:06.040+0000 7f7c05cb16c0 1 -- 10.20.193.91:0/3464163764 wait complete. 2026-02-13T01:29:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:06 trial126 ceph-mon[26569]: pgmap v298: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:06.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:06 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3464163764' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:06.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:06 trial154 ceph-mon[27045]: pgmap v298: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:06.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:06 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3464163764' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:06.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:06 trial091 ceph-mon[25068]: pgmap v298: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:06.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:06 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3464163764' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:08.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:08 trial126 ceph-mon[26569]: pgmap v299: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:08.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:08 trial154 ceph-mon[27045]: pgmap v299: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:08.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:08 trial091 ceph-mon[25068]: pgmap v299: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:09.084 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:09.204 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:09.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/1247601154 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb408115440 msgr2=0x7fb408175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/1247601154 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb408115440 0x7fb408175de0 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=10137487926759675952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3f800aa70 tx=0x7fb3f802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/1247601154 shutdown_connections 2026-02-13T01:29:09.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/1247601154 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb408115440 0x7fb408175de0 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=10137487926759675952 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/1247601154 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb40810fc20 0x7fb408114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/1247601154 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb40810f230 0x7fb40810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/1247601154 >> 10.20.193.91:0/1247601154 conn(0x7fb4080ecb30 msgr2=0x7fb40810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/1247601154 shutdown_connections 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/1247601154 wait complete. 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 Processor -- start 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.319+0000 7fb40d94b6c0 1 -- start start 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 0x7fb408066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb408115440 0x7fb408062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb408062f70 0x7fb408063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb408167bb0 con 0x7fb40810f230 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb408167d20 con 0x7fb408062f70 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb408167ee0 con 0x7fb408115440 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 0x7fb408066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 0x7fb408066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50948/0 (socket says 10.20.193.91:50948) 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 -- 10.20.193.91:0/774362755 learned_addr learned my addr 10.20.193.91:0/774362755 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb4067fc6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb408115440 0x7fb408062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb4077fe6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb408062f70 0x7fb408063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 -- 10.20.193.91:0/774362755 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb408115440 msgr2=0x7fb408062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb408115440 0x7fb408062990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 -- 10.20.193.91:0/774362755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb408062f70 msgr2=0x7fb408063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb408062f70 0x7fb408063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 -- 10.20.193.91:0/774362755 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f800a660 con 0x7fb40810f230 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb4077fe6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb408062f70 0x7fb408063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb406ffd6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 0x7fb408066730 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3fc005dc0 tx=0x7fb3fc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3fc004250 con 0x7fb40810f230 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4081681c0 con 0x7fb40810f230 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb3fc009070 con 0x7fb40810f230 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3fc00cd70 con 0x7fb40810f230 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4081686a0 con 0x7fb40810f230 2026-02-13T01:29:09.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.320+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb408110500 con 0x7fb40810f230 2026-02-13T01:29:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.322+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb3fc0028c0 con 0x7fb40810f230 2026-02-13T01:29:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.322+0000 7fb40c9456c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3dc0b56d0 0x7fb3dc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.322+0000 7fb4067fc6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3dc0b56d0 0x7fb3dc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.323+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fb3fc0e3b40 con 0x7fb40810f230 2026-02-13T01:29:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.323+0000 7fb4067fc6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3dc0b56d0 0x7fb3dc0d5b80 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3f0005980 tx=0x7fb3f0005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:09.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.323+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3fc0a64e0 con 0x7fb40810f230 2026-02-13T01:29:09.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.436+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb40810f600 con 0x7fb40810f230 2026-02-13T01:29:09.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.436+0000 7fb40c9456c0 1 -- 10.20.193.91:0/774362755 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb3fc0a9690 con 0x7fb40810f230 2026-02-13T01:29:09.437 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:09.437 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:09.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3dc0b56d0 msgr2=0x7fb3dc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3dc0b56d0 0x7fb3dc0d5b80 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3f0005980 tx=0x7fb3f0005910 comp rx=0 tx=0).stop 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 msgr2=0x7fb408066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 0x7fb408066730 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3fc005dc0 tx=0x7fb3fc00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 shutdown_connections 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3dc0b56d0 0x7fb3dc0d5b80 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb408062f70 0x7fb408063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb408115440 0x7fb408062990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 --2- 10.20.193.91:0/774362755 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb40810f230 0x7fb408066730 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 >> 10.20.193.91:0/774362755 conn(0x7fb4080ecb30 msgr2=0x7fb40810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:09.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 shutdown_connections 2026-02-13T01:29:09.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:09.437+0000 7fb40d94b6c0 1 -- 10.20.193.91:0/774362755 wait complete. 2026-02-13T01:29:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:10 trial126 ceph-mon[26569]: pgmap v300: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:10.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:10 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/774362755' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:10.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:10 trial154 ceph-mon[27045]: pgmap v300: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:10.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:10 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/774362755' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:10.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:10 trial091 ceph-mon[25068]: pgmap v300: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:10.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:10 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/774362755' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:12.480 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:12.598 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:12.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:12 trial126 ceph-mon[26569]: pgmap v301: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:12.621 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:12 trial091 ceph-mon[25068]: pgmap v301: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:12.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/1582162428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c060740 msgr2=0x7f7e9c060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:12.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/1582162428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c060740 0x7f7e9c060b10 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=10085566536984050442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e90009970 tx=0x7f7e9002ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:12.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/1582162428 shutdown_connections 2026-02-13T01:29:12.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/1582162428 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7e9c1556c0 0x7f7e9c175aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/1582162428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e9c061050 0x7f7e9c155180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/1582162428 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c060740 0x7f7e9c060b10 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=10085566536984050442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/1582162428 >> 10.20.193.91:0/1582162428 conn(0x7f7e9c0ea8b0 msgr2=0x7f7e9c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/1582162428 shutdown_connections 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/1582162428 wait complete. 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 Processor -- start 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- start start 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e9c060740 0x7f7e9c161550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 0x7f7e9c161a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7e9c1556c0 0x7f7e9c166e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:12.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c1674a0 con 0x7f7e9c061050 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c167610 con 0x7f7e9c060740 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.713+0000 7f7ea0e816c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9c1677d0 con 0x7f7e9c1556c0 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 0x7f7e9c161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 0x7f7e9c161a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50974/0 (socket says 10.20.193.91:50974) 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 -- 10.20.193.91:0/3425969893 learned_addr learned my addr 10.20.193.91:0/3425969893 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e9ad766c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7e9c1556c0 0x7f7e9c166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e9a5756c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e9c060740 0x7f7e9c161550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 -- 10.20.193.91:0/3425969893 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7e9c1556c0 msgr2=0x7f7e9c166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7e9c1556c0 0x7f7e9c166e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 -- 10.20.193.91:0/3425969893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e9c060740 msgr2=0x7f7e9c161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:12.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e9c060740 0x7f7e9c161550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 -- 10.20.193.91:0/3425969893 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e90009590 con 0x7f7e9c061050 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e99d746c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 0x7f7e9c161a90 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e84009490 tx=0x7f7e8400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e84004a80 con 0x7f7e9c061050 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9c167ab0 con 0x7f7e9c061050 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7e84009030 con 0x7f7e9c061050 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7e8400ce30 con 0x7f7e9c061050 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e9c1512f0 con 0x7f7e9c061050 2026-02-13T01:29:12.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.714+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9c061c50 con 0x7f7e9c061050 2026-02-13T01:29:12.720 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:12 trial154 ceph-mon[27045]: pgmap v301: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:12.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.716+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f7e84004060 con 0x7f7e9c061050 2026-02-13T01:29:12.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.717+0000 7f7e837fe6c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7e740b5650 0x7f7e740d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:12.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.717+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f7e840e3bd0 con 0x7f7e9c061050 2026-02-13T01:29:12.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.717+0000 7f7e9a5756c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7e740b5650 0x7f7e740d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:12.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.717+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7e840a9580 con 0x7f7e9c061050 2026-02-13T01:29:12.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.717+0000 7f7e9a5756c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7e740b5650 0x7f7e740d5b00 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e90005b40 tx=0x7f7e90005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:12.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.831+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7e9c162700 con 0x7f7e9c061050 2026-02-13T01:29:12.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.832+0000 7f7e837fe6c0 1 -- 10.20.193.91:0/3425969893 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7e840a9760 con 0x7f7e9c061050 2026-02-13T01:29:12.833 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:12.833 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:12.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7e740b5650 msgr2=0x7f7e740d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:12.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7e740b5650 0x7f7e740d5b00 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e90005b40 tx=0x7f7e90005c00 comp rx=0 tx=0).stop 2026-02-13T01:29:12.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 msgr2=0x7f7e9c161a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 0x7f7e9c161a90 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7e84009490 tx=0x7f7e8400bca0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 shutdown_connections 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f7e740b5650 0x7f7e740d5b00 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7e9c1556c0 0x7f7e9c166e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7e9c061050 0x7f7e9c161a90 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 --2- 10.20.193.91:0/3425969893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e9c060740 0x7f7e9c161550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 >> 10.20.193.91:0/3425969893 conn(0x7f7e9c0ea8b0 msgr2=0x7f7e9c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 shutdown_connections 2026-02-13T01:29:12.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:12.833+0000 7f7ea0e816c0 1 -- 10.20.193.91:0/3425969893 wait complete. 2026-02-13T01:29:13.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:13 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3425969893' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:13 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3425969893' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:13.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:13 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3425969893' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:14 trial126 ceph-mon[26569]: pgmap v302: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:14.629 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:14 trial091 ceph-mon[25068]: pgmap v302: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:14 trial154 ceph-mon[27045]: pgmap v302: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:15.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:15 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:15.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:15 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:15 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:29:15.874 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:15.993 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:16.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/532094328 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 msgr2=0x7f1f58175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/532094328 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f58175db0 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=13463744888868729318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4800aa70 tx=0x7f1f4802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/532094328 shutdown_connections 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/532094328 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f58175db0 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=13463744888868729318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/532094328 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810fbf0 0x7f1f58114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/532094328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f5810f200 0x7f1f5810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/532094328 >> 10.20.193.91:0/532094328 conn(0x7f1f580ecb00 msgr2=0x7f1f5810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/532094328 shutdown_connections 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.108+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/532094328 wait complete. 2026-02-13T01:29:16.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 Processor -- start 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 -- start start 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58123560 con 0x7f1f58115410 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f581236d0 con 0x7f1f58122b50 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58123890 con 0x7f1f5810f200 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:50980/0 (socket says 10.20.193.91:50980) 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 -- 10.20.193.91:0/3511949764 learned_addr learned my addr 10.20.193.91:0/3511949764 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f56ffd6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:16.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f577fe6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 -- 10.20.193.91:0/3511949764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810f200 msgr2=0x7f1f5811d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 -- 10.20.193.91:0/3511949764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f58122b50 msgr2=0x7f1f58122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 -- 10.20.193.91:0/3511949764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4800a660 con 0x7f1f58115410 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f577fe6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f567fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4000b6c0 tx=0x7f1f4000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f40004250 con 0x7f1f58115410 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1f40009070 con 0x7f1f58115410 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f58163d40 con 0x7f1f58115410 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f4000ccb0 con 0x7f1f58115410 2026-02-13T01:29:16.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.109+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581641d0 con 0x7f1f58115410 2026-02-13T01:29:16.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.110+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f581104d0 con 0x7f1f58115410 2026-02-13T01:29:16.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.111+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1f400028c0 con 0x7f1f58115410 2026-02-13T01:29:16.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.112+0000 7f1f37fff6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f2c0b5650 0x7f1f2c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:16.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.112+0000 7f1f56ffd6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f2c0b5650 0x7f1f2c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:16.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.112+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f1f400e3b80 con 0x7f1f58115410 2026-02-13T01:29:16.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.112+0000 7f1f56ffd6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f2c0b5650 0x7f1f2c0d5b00 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4c004750 tx=0x7f1f4c009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:16.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.113+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1f400a6560 con 0x7f1f58115410 2026-02-13T01:29:16.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.227+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f5811e3a0 con 0x7f1f58115410 2026-02-13T01:29:16.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.227+0000 7f1f37fff6c0 1 -- 10.20.193.91:0/3511949764 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1f400a9710 con 0x7f1f58115410 2026-02-13T01:29:16.228 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:16.228 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:16.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f2c0b5650 msgr2=0x7f1f2c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:16.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f2c0b5650 0x7f1f2c0d5b00 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4c004750 tx=0x7f1f4c009390 comp rx=0 tx=0).stop 2026-02-13T01:29:16.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 msgr2=0x7f1f5811d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:16.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f4000b6c0 tx=0x7f1f4000bb90 comp rx=0 tx=0).stop 2026-02-13T01:29:16.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 shutdown_connections 2026-02-13T01:29:16.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f1f2c0b5650 0x7f1f2c0d5b00 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f58122b50 0x7f1f58122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1f58115410 0x7f1f5811d790 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 --2- 10.20.193.91:0/3511949764 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1f5810f200 0x7f1f5811d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:16.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 >> 10.20.193.91:0/3511949764 conn(0x7f1f580ecb00 msgr2=0x7f1f5810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:16.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 shutdown_connections 2026-02-13T01:29:16.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:16.228+0000 7f1f5d6fc6c0 1 -- 10.20.193.91:0/3511949764 wait complete. 2026-02-13T01:29:16.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: pgmap v303: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:16.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:16.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:16.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:29:16.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:16.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:16.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:16.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:16 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3511949764' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: pgmap v303: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:16.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:16.479 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:16 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3511949764' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:16.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: pgmap v303: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:16.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:29:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:29:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:29:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:29:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:29:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:16 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3511949764' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:17.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:17 trial126 ceph-mon[26569]: pgmap v304: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T01:29:17.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:17 trial126 ceph-mon[26569]: pgmap v305: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:29:17.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:17 trial154 ceph-mon[27045]: pgmap v304: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T01:29:17.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:17 trial154 ceph-mon[27045]: pgmap v305: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:29:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:17 trial091 ceph-mon[25068]: pgmap v304: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T01:29:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:17 trial091 ceph-mon[25068]: pgmap v305: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:29:19.271 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:19.393 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:19.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/4052654591 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 msgr2=0x7fb39810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/4052654591 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39810f5d0 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=8464884214140811310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb3880099a0 tx=0x7fb38802ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/4052654591 shutdown_connections 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/4052654591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398115410 0x7fb398175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/4052654591 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb39810fbf0 0x7fb398114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/4052654591 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39810f5d0 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=8464884214140811310 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/4052654591 >> 10.20.193.91:0/4052654591 conn(0x7fb3980ecb00 msgr2=0x7fb39810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/4052654591 shutdown_connections 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/4052654591 wait complete. 2026-02-13T01:29:19.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 Processor -- start 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- start start 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb398115410 0x7fb39811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398122c30 0x7fb3981230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fb398123640 con 0x7fb39810f200 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb3981237b0 con 0x7fb398122c30 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39f2e56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb398123970 con 0x7fb398115410 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39811d330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:40596/0 (socket says 10.20.193.91:40596) 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 -- 10.20.193.91:0/2051521876 learned_addr learned my addr 10.20.193.91:0/2051521876 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:19.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39c8556c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb398115410 0x7fb39811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 -- 10.20.193.91:0/2051521876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb398115410 msgr2=0x7fb39811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb398115410 0x7fb39811d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d8576c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398122c30 0x7fb3981230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 -- 10.20.193.91:0/2051521876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398122c30 msgr2=0x7fb3981230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398122c30 0x7fb3981230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d0566c0 1 -- 10.20.193.91:0/2051521876 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb388009590 con 0x7fb39810f200 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.506+0000 7fb39d8576c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398122c30 0x7fb3981230d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb39d0566c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39811d330 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38802f230 tx=0x7fb38802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb388002ba0 con 0x7fb39810f200 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb388002d00 con 0x7fb39810f200 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3880372f0 con 0x7fb39810f200 2026-02-13T01:29:19.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb398163dc0 con 0x7fb39810f200 2026-02-13T01:29:19.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3981641f0 con 0x7fb39810f200 2026-02-13T01:29:19.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.507+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3981104d0 con 0x7fb39810f200 2026-02-13T01:29:19.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.509+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb3880078d0 con 0x7fb39810f200 2026-02-13T01:29:19.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.509+0000 7fb3867fc6c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3740b56d0 0x7fb3740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:19.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.509+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fb388107d60 con 0x7fb39810f200 2026-02-13T01:29:19.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.509+0000 7fb39c8556c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3740b56d0 0x7fb3740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:19.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.509+0000 7fb39c8556c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3740b56d0 0x7fb3740d5b80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38c006b60 tx=0x7fb38c006af0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:19.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.510+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3880ca700 con 0x7fb39810f200 2026-02-13T01:29:19.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:19 trial126 ceph-mon[26569]: pgmap v306: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:29:19.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.625+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb39810f5d0 con 0x7fb39810f200 2026-02-13T01:29:19.626 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:19 trial091 ceph-mon[25068]: pgmap v306: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:29:19.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.625+0000 7fb3867fc6c0 1 -- 10.20.193.91:0/2051521876 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb3880cd8b0 con 0x7fb39810f200 2026-02-13T01:29:19.627 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:19.627 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:19.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3740b56d0 msgr2=0x7fb3740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3740b56d0 0x7fb3740d5b80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38c006b60 tx=0x7fb38c006af0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 msgr2=0x7fb39811d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:19.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39811d330 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38802f230 tx=0x7fb38802fd40 comp rx=0 tx=0).stop 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 shutdown_connections 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fb3740b56d0 0x7fb3740d5b80 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb398122c30 0x7fb3981230d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fb398115410 0x7fb39811d870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 --2- 10.20.193.91:0/2051521876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fb39810f200 0x7fb39811d330 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 >> 10.20.193.91:0/2051521876 conn(0x7fb3980ecb00 msgr2=0x7fb39810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 shutdown_connections 2026-02-13T01:29:19.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:19.626+0000 7fb39f2e56c0 1 -- 10.20.193.91:0/2051521876 wait complete. 2026-02-13T01:29:19.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:19 trial154 ceph-mon[27045]: pgmap v306: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:29:20.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:20 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2051521876' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:20.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:20 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2051521876' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:20.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:20 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2051521876' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:21.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:21 trial126 ceph-mon[26569]: pgmap v307: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:29:21.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:21 trial154 ceph-mon[27045]: pgmap v307: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:29:21.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:21 trial091 ceph-mon[25068]: pgmap v307: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:29:22.668 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:22.788 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:22.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/307823652 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c5810fc20 msgr2=0x7f8c58114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/307823652 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c5810fc20 0x7f8c58114c60 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=12093558222388650978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c400099a0 tx=0x7f8c4002ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:22.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/307823652 shutdown_connections 2026-02-13T01:29:22.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/307823652 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 0x7f8c58175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/307823652 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c5810fc20 0x7f8c58114c60 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=12093558222388650978 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/307823652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c5810f230 0x7f8c5810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/307823652 >> 10.20.193.91:0/307823652 conn(0x7f8c580ecb30 msgr2=0x7f8c5810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/307823652 shutdown_connections 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.909+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/307823652 wait complete. 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 Processor -- start 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 -- start start 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c5810f230 0x7f8c580f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 0x7f8c58175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 0x7f8c580fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f8c580f5a00 con 0x7f8c580f5310 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c580faad0 con 0x7f8c5810f230 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c580fac90 con 0x7f8c58115440 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 0x7f8c580fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 0x7f8c580fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:40610/0 (socket says 10.20.193.91:40610) 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 -- 10.20.193.91:0/365581763 learned_addr learned my addr 10.20.193.91:0/365581763 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c565756c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c5810f230 0x7f8c580f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c55d746c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 0x7f8c58175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 -- 10.20.193.91:0/365581763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 msgr2=0x7f8c58175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 0x7f8c58175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 -- 10.20.193.91:0/365581763 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c5810f230 msgr2=0x7f8c580f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c5810f230 0x7f8c580f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:22.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 -- 10.20.193.91:0/365581763 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c40009590 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c55d746c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 0x7f8c58175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c56d766c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 0x7f8c580fa590 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c48006ea0 tx=0x7f8c4800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c48003a30 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8c480054f0 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c580faf70 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c4800dcd0 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.910+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c580fb700 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.911+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c580fb450 con 0x7f8c580f5310 2026-02-13T01:29:22.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.912+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8c48003b90 con 0x7f8c580f5310 2026-02-13T01:29:22.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.913+0000 7f8c3f7fe6c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c300b56d0 0x7f8c300d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:22.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.913+0000 7f8c565756c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c300b56d0 0x7f8c300d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:22.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.913+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f8c480e4b10 con 0x7f8c580f5310 2026-02-13T01:29:22.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.913+0000 7f8c565756c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c300b56d0 0x7f8c300d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c4c004750 tx=0x7f8c4c009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:22.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:22.913+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8c480a74f0 con 0x7f8c580f5310 2026-02-13T01:29:23.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.029+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8c580f5de0 con 0x7f8c580f5310 2026-02-13T01:29:23.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.029+0000 7f8c3f7fe6c0 1 -- 10.20.193.91:0/365581763 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8c4800de60 con 0x7f8c580f5310 2026-02-13T01:29:23.030 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:23.030 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:23.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c300b56d0 msgr2=0x7f8c300d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:23.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c300b56d0 0x7f8c300d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c4c004750 tx=0x7f8c4c009390 comp rx=0 tx=0).stop 2026-02-13T01:29:23.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 msgr2=0x7f8c580fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:23.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 0x7f8c580fa590 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c48006ea0 tx=0x7f8c4800cca0 comp rx=0 tx=0).stop 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 shutdown_connections 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f8c300b56d0 0x7f8c300d5b80 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f8c580f5310 0x7f8c580fa590 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f8c58115440 0x7f8c58175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 --2- 10.20.193.91:0/365581763 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c5810f230 0x7f8c580f4ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 >> 10.20.193.91:0/365581763 conn(0x7f8c580ecb30 msgr2=0x7f8c5810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 shutdown_connections 2026-02-13T01:29:23.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:23.030+0000 7f8c5cf146c0 1 -- 10.20.193.91:0/365581763 wait complete. 2026-02-13T01:29:23.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:23 trial126 ceph-mon[26569]: pgmap v308: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:29:23.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:23 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/365581763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:23.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:23 trial154 ceph-mon[27045]: pgmap v308: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:29:23.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:23 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/365581763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:23.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:23 trial091 ceph-mon[25068]: pgmap v308: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:29:23.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:23 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/365581763' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:25.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:25 trial126 ceph-mon[26569]: pgmap v309: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:29:25.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:25 trial154 ceph-mon[27045]: pgmap v309: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:29:25.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:25 trial091 ceph-mon[25068]: pgmap v309: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:29:26.071 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:26.189 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:26.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/2732194965 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c10fbf0 msgr2=0x7f4f2c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/2732194965 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c10fbf0 0x7f4f2c114c30 secure :-1 s=READY pgs=445 gs=3 cs=0 l=1 c_cookie=4820069044874650186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f1c0099a0 tx=0x7f4f1c02ed50 comp rx=0 tx=0).stop 2026-02-13T01:29:26.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/2732194965 shutdown_connections 2026-02-13T01:29:26.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/2732194965 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c115410 0x7f4f2c175db0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/2732194965 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c10fbf0 0x7f4f2c114c30 unknown :-1 s=CLOSED pgs=445 gs=3 cs=0 l=1 c_cookie=4820069044874650186 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/2732194965 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 0x7f4f2c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/2732194965 >> 10.20.193.91:0/2732194965 conn(0x7f4f2c0ecb00 msgr2=0x7f4f2c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/2732194965 shutdown_connections 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.300+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/2732194965 wait complete. 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 Processor -- start 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 -- start start 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 0x7f4f2c0f4c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 0x7f4f2c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c0f52b0 0x7f4f2c0fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0f59a0 con 0x7f4f2c115410 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0faac0 con 0x7f4f2c0f52b0 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2c0fac80 con 0x7f4f2c10f200 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 0x7f4f2c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 0x7f4f2c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:40626/0 (socket says 10.20.193.91:40626) 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 -- 10.20.193.91:0/3353631943 learned_addr learned my addr 10.20.193.91:0/3353631943 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2b7fe6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 0x7f4f2c0f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2bfff6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c0f52b0 0x7f4f2c0fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 -- 10.20.193.91:0/3353631943 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 msgr2=0x7f4f2c0f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 0x7f4f2c0f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 -- 10.20.193.91:0/3353631943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c0f52b0 msgr2=0x7f4f2c0fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c0f52b0 0x7f4f2c0fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 -- 10.20.193.91:0/3353631943 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c009590 con 0x7f4f2c115410 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2b7fe6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 0x7f4f2c0f4c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2bfff6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c0f52b0 0x7f4f2c0fa580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f2affd6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 0x7f4f2c175cb0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f1c0023a0 tx=0x7f4f1c02fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f1c002ae0 con 0x7f4f2c115410 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4f1c002c40 con 0x7f4f2c115410 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2c0faf00 con 0x7f4f2c115410 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4f1c037070 con 0x7f4f2c115410 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.301+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f2c0fb3d0 con 0x7f4f2c115410 2026-02-13T01:29:26.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.302+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2c1104d0 con 0x7f4f2c115410 2026-02-13T01:29:26.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.303+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4f1c0071c0 con 0x7f4f2c115410 2026-02-13T01:29:26.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.304+0000 7f4f28ff96c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4f000b56d0 0x7f4f000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:26.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.304+0000 7f4f2b7fe6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4f000b56d0 0x7f4f000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:26.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.304+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f4f1c107d60 con 0x7f4f2c115410 2026-02-13T01:29:26.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.304+0000 7f4f2b7fe6c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4f000b56d0 0x7f4f000d5b80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f18005fd0 tx=0x7f4f18009650 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:26.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.304+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4f1c0ca700 con 0x7f4f2c115410 2026-02-13T01:29:26.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.421+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4f2c0f5dd0 con 0x7f4f2c115410 2026-02-13T01:29:26.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.421+0000 7f4f28ff96c0 1 -- 10.20.193.91:0/3353631943 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4f1c0cd8b0 con 0x7f4f2c115410 2026-02-13T01:29:26.422 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:26.422 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4f000b56d0 msgr2=0x7f4f000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4f000b56d0 0x7f4f000d5b80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f18005fd0 tx=0x7f4f18009650 comp rx=0 tx=0).stop 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 msgr2=0x7f4f2c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 0x7f4f2c175cb0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f1c0023a0 tx=0x7f4f1c02fb70 comp rx=0 tx=0).stop 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 shutdown_connections 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f4f000b56d0 0x7f4f000d5b80 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f2c0f52b0 0x7f4f2c0fa580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4f2c115410 0x7f4f2c175cb0 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 --2- 10.20.193.91:0/3353631943 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f4f2c10f200 0x7f4f2c0f4c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:26.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 >> 10.20.193.91:0/3353631943 conn(0x7f4f2c0ecb00 msgr2=0x7f4f2c10d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:26.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 shutdown_connections 2026-02-13T01:29:26.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:26.423+0000 7f4f31fc16c0 1 -- 10.20.193.91:0/3353631943 wait complete. 2026-02-13T01:29:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:27 trial126 ceph-mon[26569]: pgmap v310: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T01:29:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:27 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3353631943' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:27.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:27 trial154 ceph-mon[27045]: pgmap v310: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T01:29:27.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:27 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3353631943' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:27.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:27 trial091 ceph-mon[25068]: pgmap v310: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T01:29:27.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:27 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3353631943' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:29.465 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:29.583 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:29 trial126 ceph-mon[26569]: pgmap v311: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:29.607 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:29 trial091 ceph-mon[25068]: pgmap v311: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:29.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- 10.20.193.91:0/3621206458 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c10fc20 msgr2=0x7f704c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/3621206458 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c10fc20 0x7f704c114c60 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=14467913304707466279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70340099a0 tx=0x7f703402ed50 comp rx=0 tx=0).stop 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- 10.20.193.91:0/3621206458 shutdown_connections 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/3621206458 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f704c115440 0x7f704c175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/3621206458 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c10fc20 0x7f704c114c60 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=14467913304707466279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/3621206458 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f704c10f230 0x7f704c10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- 10.20.193.91:0/3621206458 >> 10.20.193.91:0/3621206458 conn(0x7f704c0ecb30 msgr2=0x7f704c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- 10.20.193.91:0/3621206458 shutdown_connections 2026-02-13T01:29:29.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- 10.20.193.91:0/3621206458 wait complete. 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 Processor -- start 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- start start 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f704c10f230 0x7f704c0f4cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f704c115440 0x7f704c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 0x7f704c0fa5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f704c0f59e0 con 0x7f704c0f52f0 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f704c0fab00 con 0x7f704c115440 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7050cf96c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f704c0facc0 con 0x7f704c10f230 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f704ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 0x7f704c0fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f704ad766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 0x7f704c0fa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:34012/0 (socket says 10.20.193.91:34012) 2026-02-13T01:29:29.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f704ad766c0 1 -- 10.20.193.91:0/4124488057 learned_addr learned my addr 10.20.193.91:0/4124488057 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f704a5756c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f704c10f230 0x7f704c0f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.695+0000 7f7049d746c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f704c115440 0x7f704c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f704ad766c0 1 -- 10.20.193.91:0/4124488057 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f704c10f230 msgr2=0x7f704c0f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f704ad766c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f704c10f230 0x7f704c0f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f704ad766c0 1 -- 10.20.193.91:0/4124488057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f704c115440 msgr2=0x7f704c175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f704ad766c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f704c115440 0x7f704c175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f704ad766c0 1 -- 10.20.193.91:0/4124488057 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7034009590 con 0x7f704c0f52f0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f704ad766c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 0x7f704c0fa5c0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f703c006ea0 tx=0x7f703c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f703c003a30 con 0x7f704c0f52f0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704c0fafa0 con 0x7f704c0f52f0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f703c0054f0 con 0x7f704c0f52f0 2026-02-13T01:29:29.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f703c00dcd0 con 0x7f704c0f52f0 2026-02-13T01:29:29.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f704c0fb730 con 0x7f704c0f52f0 2026-02-13T01:29:29.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.696+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704c0fb480 con 0x7f704c0f52f0 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.698+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f703c003b90 con 0x7f704c0f52f0 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.698+0000 7f70337fe6c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f70240b5650 0x7f70240d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.698+0000 7f704a5756c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f70240b5650 0x7f70240d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.698+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f703c0e4c00 con 0x7f704c0f52f0 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.699+0000 7f704a5756c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f70240b5650 0x7f70240d5b00 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7040005980 tx=0x7f7040005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:29.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.699+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f703c0ab040 con 0x7f704c0f52f0 2026-02-13T01:29:29.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:29 trial154 ceph-mon[27045]: pgmap v311: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:29.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.812+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f704c0f5e10 con 0x7f704c0f52f0 2026-02-13T01:29:29.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.813+0000 7f70337fe6c0 1 -- 10.20.193.91:0/4124488057 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f703c00de60 con 0x7f704c0f52f0 2026-02-13T01:29:29.814 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:29.814 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:29.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.813+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f70240b5650 msgr2=0x7f70240d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.813+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f70240b5650 0x7f70240d5b00 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7040005980 tx=0x7f7040005910 comp rx=0 tx=0).stop 2026-02-13T01:29:29.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.813+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 msgr2=0x7f704c0fa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:29.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.813+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 0x7f704c0fa5c0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f703c006ea0 tx=0x7f703c00cca0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 shutdown_connections 2026-02-13T01:29:29.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f70240b5650 0x7f70240d5b00 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f704c0f52f0 0x7f704c0fa5c0 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f704c115440 0x7f704c175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 --2- 10.20.193.91:0/4124488057 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f704c10f230 0x7f704c0f4cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:29.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 >> 10.20.193.91:0/4124488057 conn(0x7f704c0ecb30 msgr2=0x7f704c10d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:29.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 shutdown_connections 2026-02-13T01:29:29.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:29.814+0000 7f7050cf96c0 1 -- 10.20.193.91:0/4124488057 wait complete. 2026-02-13T01:29:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:30 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4124488057' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:30.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:30 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4124488057' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:30.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:30 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4124488057' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:31 trial126 ceph-mon[26569]: pgmap v312: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:31.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:31 trial154 ceph-mon[27045]: pgmap v312: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:31.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:31 trial091 ceph-mon[25068]: pgmap v312: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:32.855 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:32.976 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1095440184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8115410 msgr2=0x7fd9f8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1095440184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8115410 0x7fd9f8175db0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=13389187255166770496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9e800aa70 tx=0x7fd9e802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1095440184 shutdown_connections 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1095440184 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8115410 0x7fd9f8175db0 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=13389187255166770496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1095440184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd9f810fbf0 0x7fd9f8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1095440184 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd9f810f200 0x7fd9f810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1095440184 >> 10.20.193.91:0/1095440184 conn(0x7fd9f80ecb00 msgr2=0x7fd9f810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:33.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1095440184 shutdown_connections 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1095440184 wait complete. 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 Processor -- start 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.094+0000 7fd9fce536c0 1 -- start start 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd9f810f200 0x7fd9f811d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd9f8115410 0x7fd9f811d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 0x7fd9f8122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8123510 con 0x7fd9f8122b00 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8123680 con 0x7fd9f8115410 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8123840 con 0x7fd9f810f200 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 0x7fd9f8122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 0x7fd9f8122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:34030/0 (socket says 10.20.193.91:34030) 2026-02-13T01:29:33.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 -- 10.20.193.91:0/1332842730 learned_addr learned my addr 10.20.193.91:0/1332842730 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f65756c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd9f810f200 0x7fd9f811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f5d746c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd9f8115410 0x7fd9f811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 -- 10.20.193.91:0/1332842730 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd9f810f200 msgr2=0x7fd9f811d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd9f810f200 0x7fd9f811d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 -- 10.20.193.91:0/1332842730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd9f8115410 msgr2=0x7fd9f811d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd9f8115410 0x7fd9f811d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 -- 10.20.193.91:0/1332842730 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e800a660 con 0x7fd9f8122b00 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9f6d766c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 0x7fd9f8122fa0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9e8006ec0 tx=0x7fd9e8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9e8003c40 con 0x7fd9f8122b00 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f8163c90 con 0x7fd9f8122b00 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd9e8005780 con 0x7fd9f8122b00 2026-02-13T01:29:33.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9e80382f0 con 0x7fd9f8122b00 2026-02-13T01:29:33.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.095+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f81640c0 con 0x7fd9f8122b00 2026-02-13T01:29:33.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.096+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f81104d0 con 0x7fd9f8122b00 2026-02-13T01:29:33.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.097+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd9e8008260 con 0x7fd9f8122b00 2026-02-13T01:29:33.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.098+0000 7fd9df7fe6c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd9d00b5650 0x7fd9d00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:33.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.098+0000 7fd9f65756c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd9d00b5650 0x7fd9d00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:33.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.098+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fd9e8108f50 con 0x7fd9f8122b00 2026-02-13T01:29:33.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.098+0000 7fd9f65756c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd9d00b5650 0x7fd9d00d5b00 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9ec004750 tx=0x7fd9ec009390 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:33.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.098+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd9e80ceaa0 con 0x7fd9f8122b00 2026-02-13T01:29:33.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.212+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd9f811e350 con 0x7fd9f8122b00 2026-02-13T01:29:33.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.212+0000 7fd9df7fe6c0 1 -- 10.20.193.91:0/1332842730 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd9e80cec80 con 0x7fd9f8122b00 2026-02-13T01:29:33.213 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:33.214 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd9d00b5650 msgr2=0x7fd9d00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd9d00b5650 0x7fd9d00d5b00 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9ec004750 tx=0x7fd9ec009390 comp rx=0 tx=0).stop 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 msgr2=0x7fd9f8122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 0x7fd9f8122fa0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9e8006ec0 tx=0x7fd9e8005520 comp rx=0 tx=0).stop 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 shutdown_connections 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd9d00b5650 0x7fd9d00d5b00 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd9f8122b00 0x7fd9f8122fa0 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd9f8115410 0x7fd9f811d740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 --2- 10.20.193.91:0/1332842730 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd9f810f200 0x7fd9f811d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:33.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 >> 10.20.193.91:0/1332842730 conn(0x7fd9f80ecb00 msgr2=0x7fd9f810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:33.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 shutdown_connections 2026-02-13T01:29:33.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:33.214+0000 7fd9fce536c0 1 -- 10.20.193.91:0/1332842730 wait complete. 2026-02-13T01:29:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:33 trial091 ceph-mon[25068]: pgmap v313: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:33.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:33 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1332842730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:33 trial126 ceph-mon[26569]: pgmap v313: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:33 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1332842730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:33.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:33 trial154 ceph-mon[27045]: pgmap v313: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:33.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:33 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1332842730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:35.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:35 trial126 ceph-mon[26569]: pgmap v314: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:35.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:35 trial154 ceph-mon[27045]: pgmap v314: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:35.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:35 trial091 ceph-mon[25068]: pgmap v314: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:36.256 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:36.373 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/1649066382 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 msgr2=0x7f6d0c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/1649066382 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c175db0 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=6397052800127280435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0800aa70 tx=0x7f6d0802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/1649066382 shutdown_connections 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/1649066382 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c175db0 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=6397052800127280435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/1649066382 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d0c10fbf0 0x7f6d0c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/1649066382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 0x7f6d0c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/1649066382 >> 10.20.193.91:0/1649066382 conn(0x7f6d0c0ecb00 msgr2=0x7f6d0c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/1649066382 shutdown_connections 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.490+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/1649066382 wait complete. 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 Processor -- start 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 -- start start 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 0x7f6d0c11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d0c122b50 0x7f6d0c122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c123560 con 0x7f6d0c115410 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1236d0 con 0x7f6d0c10f200 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c123890 con 0x7f6d0c122b50 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c11d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:34036/0 (socket says 10.20.193.91:34036) 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 -- 10.20.193.91:0/721671588 learned_addr learned my addr 10.20.193.91:0/721671588 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d110e16c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 0x7f6d0c11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:36.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 -- 10.20.193.91:0/721671588 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d0c122b50 msgr2=0x7f6d0c122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d0c122b50 0x7f6d0c122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 -- 10.20.193.91:0/721671588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 msgr2=0x7f6d0c11d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 0x7f6d0c11d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 -- 10.20.193.91:0/721671588 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0800a660 con 0x7f6d0c115410 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d110e16c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 0x7f6d0c11d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d108e06c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c11d790 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0000b6c0 tx=0x7f6d0000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d00004250 con 0x7f6d0c115410 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6d00009070 con 0x7f6d0c115410 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c163d40 con 0x7f6d0c115410 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d0000ccb0 con 0x7f6d0c115410 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.491+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c1641d0 con 0x7f6d0c115410 2026-02-13T01:29:36.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.492+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0c1104d0 con 0x7f6d0c115410 2026-02-13T01:29:36.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.493+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6d000028c0 con 0x7f6d0c115410 2026-02-13T01:29:36.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.494+0000 7f6cfa7fc6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6ce80b56d0 0x7f6ce80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:36.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.494+0000 7f6d110e16c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6ce80b56d0 0x7f6ce80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:36.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.494+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f6d000e3c30 con 0x7f6d0c115410 2026-02-13T01:29:36.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.494+0000 7f6d110e16c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6ce80b56d0 0x7f6ce80d5b80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cfc004750 tx=0x7f6cfc009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:36.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.494+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d000aa030 con 0x7f6d0c115410 2026-02-13T01:29:36.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.608+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6d0c10f5d0 con 0x7f6d0c115410 2026-02-13T01:29:36.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.608+0000 7f6cfa7fc6c0 1 -- 10.20.193.91:0/721671588 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6d000a9780 con 0x7f6d0c115410 2026-02-13T01:29:36.609 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:36.609 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:36.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6ce80b56d0 msgr2=0x7f6ce80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:36.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6ce80b56d0 0x7f6ce80d5b80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cfc004750 tx=0x7f6cfc009260 comp rx=0 tx=0).stop 2026-02-13T01:29:36.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 msgr2=0x7f6d0c11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:36.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c11d790 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d0000b6c0 tx=0x7f6d0000bb90 comp rx=0 tx=0).stop 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 shutdown_connections 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f6ce80b56d0 0x7f6ce80d5b80 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6d0c122b50 0x7f6d0c122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6d0c115410 0x7f6d0c11d790 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 --2- 10.20.193.91:0/721671588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d0c10f200 0x7f6d0c11d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 >> 10.20.193.91:0/721671588 conn(0x7f6d0c0ecb00 msgr2=0x7f6d0c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 shutdown_connections 2026-02-13T01:29:36.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:36.609+0000 7f6d1336c6c0 1 -- 10.20.193.91:0/721671588 wait complete. 2026-02-13T01:29:37.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:37 trial154 ceph-mon[27045]: pgmap v315: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:37.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:37 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/721671588' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:37 trial091 ceph-mon[25068]: pgmap v315: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:37.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:37 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/721671588' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:37.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:37 trial126 ceph-mon[26569]: pgmap v315: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:37.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:37 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/721671588' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:39.651 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:39.676 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:39 trial091 ceph-mon[25068]: pgmap v316: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:39.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:39 trial154 ceph-mon[27045]: pgmap v316: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:39.770 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:39.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:39 trial126 ceph-mon[26569]: pgmap v316: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:39.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- 10.20.193.91:0/3119647794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 msgr2=0x7ff260175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:39.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/3119647794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff260175de0 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=17692047983023295847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25400aa70 tx=0x7ff25402fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:39.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- 10.20.193.91:0/3119647794 shutdown_connections 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/3119647794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff260175de0 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=17692047983023295847 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/3119647794 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff26010fc20 0x7ff260114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/3119647794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff26010f230 0x7ff26010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- 10.20.193.91:0/3119647794 >> 10.20.193.91:0/3119647794 conn(0x7ff2600ecb30 msgr2=0x7ff26010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- 10.20.193.91:0/3119647794 shutdown_connections 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- 10.20.193.91:0/3119647794 wait complete. 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 Processor -- start 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- start start 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff26010f230 0x7ff26011d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff26011d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:39.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff260122af0 0x7ff260122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7ff260123500 con 0x7ff260115440 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff260123670 con 0x7ff26010f230 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff265ae56c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff260123830 con 0x7ff260122af0 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff25effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff26011d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff25effd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff26011d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:40076/0 (socket says 10.20.193.91:40076) 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.886+0000 7ff25effd6c0 1 -- 10.20.193.91:0/496406719 learned_addr learned my addr 10.20.193.91:0/496406719 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25ffff6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff260122af0 0x7ff260122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25f7fe6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff26010f230 0x7ff26011d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25effd6c0 1 -- 10.20.193.91:0/496406719 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff260122af0 msgr2=0x7ff260122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25effd6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff260122af0 0x7ff260122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25effd6c0 1 -- 10.20.193.91:0/496406719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff26010f230 msgr2=0x7ff26011d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:39.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25effd6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff26010f230 0x7ff26011d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25effd6c0 1 -- 10.20.193.91:0/496406719 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25400a660 con 0x7ff260115440 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25effd6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff26011d730 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25000b800 tx=0x7ff25000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff250004a80 con 0x7ff260115440 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff260163ce0 con 0x7ff260115440 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff250009070 con 0x7ff260115440 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff25000cdd0 con 0x7ff260115440 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2601641c0 con 0x7ff260115440 2026-02-13T01:29:39.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.887+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff260110500 con 0x7ff260115440 2026-02-13T01:29:39.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.889+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff250004060 con 0x7ff260115440 2026-02-13T01:29:39.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.889+0000 7ff25cff96c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2340b5650 0x7ff2340d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:39.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.889+0000 7ff25f7fe6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2340b5650 0x7ff2340d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:39.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.889+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7ff2500e3c20 con 0x7ff260115440 2026-02-13T01:29:39.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.890+0000 7ff25f7fe6c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2340b5650 0x7ff2340d5b00 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c004750 tx=0x7ff24c009260 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:39.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:39.890+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff2500a65c0 con 0x7ff260115440 2026-02-13T01:29:40.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.005+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff26010f600 con 0x7ff260115440 2026-02-13T01:29:40.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.005+0000 7ff25cff96c0 1 -- 10.20.193.91:0/496406719 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff2500a9770 con 0x7ff260115440 2026-02-13T01:29:40.005 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:40.005 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:40.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2340b5650 msgr2=0x7ff2340d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2340b5650 0x7ff2340d5b00 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c004750 tx=0x7ff24c009260 comp rx=0 tx=0).stop 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 msgr2=0x7ff26011d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff26011d730 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25000b800 tx=0x7ff25000bcd0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 shutdown_connections 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7ff2340b5650 0x7ff2340d5b00 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7ff260122af0 0x7ff260122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7ff260115440 0x7ff26011d730 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 --2- 10.20.193.91:0/496406719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff26010f230 0x7ff26011d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 >> 10.20.193.91:0/496406719 conn(0x7ff2600ecb30 msgr2=0x7ff26010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 shutdown_connections 2026-02-13T01:29:40.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:40.006+0000 7ff265ae56c0 1 -- 10.20.193.91:0/496406719 wait complete. 2026-02-13T01:29:40.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:40 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/496406719' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:40.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:40 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/496406719' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:40.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:40 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/496406719' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:41.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:41 trial154 ceph-mon[27045]: pgmap v317: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:41.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:41 trial091 ceph-mon[25068]: pgmap v317: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:41.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:41 trial126 ceph-mon[26569]: pgmap v317: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:43.048 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:43.169 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2669087676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f684010f200 msgr2=0x7f684010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2669087676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f684010f200 0x7f684010f5d0 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=8951087488704226305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68340099a0 tx=0x7f683402ed20 comp rx=0 tx=0).stop 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2669087676 shutdown_connections 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2669087676 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6840115410 0x7f6840175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2669087676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f684010fbf0 0x7f6840114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2669087676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f684010f200 0x7f684010f5d0 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=8951087488704226305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.286 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2669087676 >> 10.20.193.91:0/2669087676 conn(0x7f68400ecb00 msgr2=0x7f684010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2669087676 shutdown_connections 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2669087676 wait complete. 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 Processor -- start 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- start start 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f684010f200 0x7f684011d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 0x7f684011d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6840122c50 0x7f68401230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f6840123660 con 0x7f6840115410 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f68401237d0 con 0x7f6840122c50 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.284+0000 7f6844cdd6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6840123990 con 0x7f684010f200 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 0x7f684011d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:43.287 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 0x7f684011d890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:40108/0 (socket says 10.20.193.91:40108) 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 -- 10.20.193.91:0/2269230141 learned_addr learned my addr 10.20.193.91:0/2269230141 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683e5756c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f684010f200 0x7f684011d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683ed766c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6840122c50 0x7f68401230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 -- 10.20.193.91:0/2269230141 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f684010f200 msgr2=0x7f684011d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f684010f200 0x7f684011d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 -- 10.20.193.91:0/2269230141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6840122c50 msgr2=0x7f68401230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6840122c50 0x7f68401230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 -- 10.20.193.91:0/2269230141 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6834009590 con 0x7f6840115410 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f683dd746c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 0x7f684011d890 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f682800b6c0 tx=0x7f682800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f68280044a0 con 0x7f6840115410 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6828009030 con 0x7f6840115410 2026-02-13T01:29:43.288 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6840163e40 con 0x7f6840115410 2026-02-13T01:29:43.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f682800cc10 con 0x7f6840115410 2026-02-13T01:29:43.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6840164320 con 0x7f6840115410 2026-02-13T01:29:43.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.285+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68401104d0 con 0x7f6840115410 2026-02-13T01:29:43.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.287+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f68280026b0 con 0x7f6840115410 2026-02-13T01:29:43.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.287+0000 7f68277fe6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f68180b56d0 0x7f68180d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:43.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.288+0000 7f683e5756c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f68180b56d0 0x7f68180d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:43.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.288+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f68280e3840 con 0x7f6840115410 2026-02-13T01:29:43.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.288+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f68280a9c80 con 0x7f6840115410 2026-02-13T01:29:43.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.288+0000 7f683e5756c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f68180b56d0 0x7f68180d5b80 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6834005b40 tx=0x7f68340023a0 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:43.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.402+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f684010f5d0 con 0x7f6840115410 2026-02-13T01:29:43.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.402+0000 7f68277fe6c0 1 -- 10.20.193.91:0/2269230141 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f68280abcf0 con 0x7f6840115410 2026-02-13T01:29:43.402 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:43.402 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:43.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f68180b56d0 msgr2=0x7f68180d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:43.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f68180b56d0 0x7f68180d5b80 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6834005b40 tx=0x7f68340023a0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 msgr2=0x7f684011d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 0x7f684011d890 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f682800b6c0 tx=0x7f682800bb90 comp rx=0 tx=0).stop 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 shutdown_connections 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f68180b56d0 0x7f68180d5b80 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6840122c50 0x7f68401230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6840115410 0x7f684011d890 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 --2- 10.20.193.91:0/2269230141 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f684010f200 0x7f684011d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 >> 10.20.193.91:0/2269230141 conn(0x7f68400ecb00 msgr2=0x7f684010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 shutdown_connections 2026-02-13T01:29:43.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:43.403+0000 7f6844cdd6c0 1 -- 10.20.193.91:0/2269230141 wait complete. 2026-02-13T01:29:43.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:43 trial154 ceph-mon[27045]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:43.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:43 trial091 ceph-mon[25068]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:43.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:43 trial126 ceph-mon[26569]: pgmap v318: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:44.630 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:44 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2269230141' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:44.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:44 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2269230141' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:44.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:44 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2269230141' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:45.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:45 trial154 ceph-mon[27045]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:45.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:45 trial091 ceph-mon[25068]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:45.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:45 trial126 ceph-mon[26569]: pgmap v319: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:46.443 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:46.563 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:46.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/3434946876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010b120 msgr2=0x7f14d010b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:46.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/3434946876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010b120 0x7f14d010b550 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=11416076571359704387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14c0009970 tx=0x7f14c002ed50 comp rx=0 tx=0).stop 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/3434946876 shutdown_connections 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/3434946876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010bd00 0x7f14d0175a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/3434946876 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010b120 0x7f14d010b550 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=11416076571359704387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/3434946876 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14d010dad0 0x7f14d010dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/3434946876 >> 10.20.193.91:0/3434946876 conn(0x7f14d0062e00 msgr2=0x7f14d0109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/3434946876 shutdown_connections 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/3434946876 wait complete. 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 Processor -- start 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- start start 2026-02-13T01:29:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14d010b120 0x7f14d00f52e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 0x7f14d00f5820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010dad0 0x7f14d00fabe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00fb230 con 0x7f14d010bd00 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00fb3a0 con 0x7f14d010dad0 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d67dc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00fb560 con 0x7f14d010b120 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14cf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 0x7f14d00f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14cf7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 0x7f14d00f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:40124/0 (socket says 10.20.193.91:40124) 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14cf7fe6c0 1 -- 10.20.193.91:0/1971304676 learned_addr learned my addr 10.20.193.91:0/1971304676 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14cffff6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14d010b120 0x7f14d00f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14cf7fe6c0 1 -- 10.20.193.91:0/1971304676 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14d010b120 msgr2=0x7f14d00f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14d4d526c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010dad0 0x7f14d00fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.685+0000 7f14cf7fe6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14d010b120 0x7f14d00f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cf7fe6c0 1 -- 10.20.193.91:0/1971304676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010dad0 msgr2=0x7f14d00fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cf7fe6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010dad0 0x7f14d00fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cf7fe6c0 1 -- 10.20.193.91:0/1971304676 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c0009590 con 0x7f14d010bd00 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14d4d526c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010dad0 0x7f14d00fabe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cf7fe6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 0x7f14d00f5820 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14c0009290 tx=0x7f14c002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14c0002ae0 con 0x7f14d010bd00 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d00fb7e0 con 0x7f14d010bd00 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f14c0007680 con 0x7f14d010bd00 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f14c00375c0 con 0x7f14d010bd00 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d0172bf0 con 0x7f14d010bd00 2026-02-13T01:29:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.686+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d010c130 con 0x7f14d010bd00 2026-02-13T01:29:46.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.688+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f14c0002c60 con 0x7f14d010bd00 2026-02-13T01:29:46.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.689+0000 7f14cd7fa6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f14a40b56d0 0x7f14a40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:46.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.689+0000 7f14cffff6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f14a40b56d0 0x7f14a40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:46.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.689+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f14c0107db0 con 0x7f14d010bd00 2026-02-13T01:29:46.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.689+0000 7f14cffff6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f14a40b56d0 0x7f14a40d5b80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14bc005980 tx=0x7f14bc005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:46.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.690+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f14c00ca790 con 0x7f14d010bd00 2026-02-13T01:29:46.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.807+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f14d00f6430 con 0x7f14d010bd00 2026-02-13T01:29:46.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.807+0000 7f14cd7fa6c0 1 -- 10.20.193.91:0/1971304676 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f14c00cd940 con 0x7f14d010bd00 2026-02-13T01:29:46.807 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:46.807 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:46.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f14a40b56d0 msgr2=0x7f14a40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:46.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f14a40b56d0 0x7f14a40d5b80 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14bc005980 tx=0x7f14bc005910 comp rx=0 tx=0).stop 2026-02-13T01:29:46.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 msgr2=0x7f14d00f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:46.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 0x7f14d00f5820 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14c0009290 tx=0x7f14c002fbf0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 shutdown_connections 2026-02-13T01:29:46.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f14a40b56d0 0x7f14a40d5b80 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14d010dad0 0x7f14d00fabe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f14d010bd00 0x7f14d00f5820 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 --2- 10.20.193.91:0/1971304676 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f14d010b120 0x7f14d00f52e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:46.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 >> 10.20.193.91:0/1971304676 conn(0x7f14d0062e00 msgr2=0x7f14d00eb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:46.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 shutdown_connections 2026-02-13T01:29:46.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:46.808+0000 7f14d67dc6c0 1 -- 10.20.193.91:0/1971304676 wait complete. 2026-02-13T01:29:47.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:47 trial154 ceph-mon[27045]: pgmap v320: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:47.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:47 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1971304676' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:47.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:47 trial091 ceph-mon[25068]: pgmap v320: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:47.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:47 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1971304676' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:47.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:47 trial126 ceph-mon[26569]: pgmap v320: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:47.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:47 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1971304676' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:49.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:49 trial154 ceph-mon[27045]: pgmap v321: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:49.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:49 trial091 ceph-mon[25068]: pgmap v321: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:49.848 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:49.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:49 trial126 ceph-mon[26569]: pgmap v321: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:49.968 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1644975420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 msgr2=0x7f594c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1644975420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c175db0 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=7538331187031763401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f594800aa70 tx=0x7f594802fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1644975420 shutdown_connections 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1644975420 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c175db0 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=7538331187031763401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1644975420 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594c10fbf0 0x7f594c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1644975420 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f594c10f200 0x7f594c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1644975420 >> 10.20.193.91:0/1644975420 conn(0x7f594c0ecb00 msgr2=0x7f594c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1644975420 shutdown_connections 2026-02-13T01:29:50.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1644975420 wait complete. 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 Processor -- start 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.087+0000 7f59537ac6c0 1 -- start start 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f594c10f200 0x7f594c11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594c122b50 0x7f594c122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f594c123560 con 0x7f594c115410 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f594c1236d0 con 0x7f594c10f200 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f594c123890 con 0x7f594c122b50 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c11d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48220/0 (socket says 10.20.193.91:48220) 2026-02-13T01:29:50.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 -- 10.20.193.91:0/1499755713 learned_addr learned my addr 10.20.193.91:0/1499755713 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5951d1e6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594c122b50 0x7f594c122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 -- 10.20.193.91:0/1499755713 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594c122b50 msgr2=0x7f594c122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594c122b50 0x7f594c122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 -- 10.20.193.91:0/1499755713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f594c10f200 msgr2=0x7f594c11d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f594c10f200 0x7f594c11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 -- 10.20.193.91:0/1499755713 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594800a660 con 0x7f594c115410 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f5950d1c6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c11d790 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f594000b6c0 tx=0x7f594000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59400044a0 con 0x7f594c115410 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5940009030 con 0x7f594c115410 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c163d40 con 0x7f594c115410 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f594000cc10 con 0x7f594c115410 2026-02-13T01:29:50.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c164220 con 0x7f594c115410 2026-02-13T01:29:50.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.088+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594c1104d0 con 0x7f594c115410 2026-02-13T01:29:50.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.090+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f59400026b0 con 0x7f594c115410 2026-02-13T01:29:50.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.090+0000 7f593a7fc6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f59280b56d0 0x7f59280d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:50.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.091+0000 7f595151d6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f59280b56d0 0x7f59280d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:50.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.091+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f59400e3a20 con 0x7f594c115410 2026-02-13T01:29:50.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.091+0000 7f595151d6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f59280b56d0 0x7f59280d5b80 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c005980 tx=0x7f593c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:50.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.091+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f59400a63c0 con 0x7f594c115410 2026-02-13T01:29:50.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.207+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f594c10f5d0 con 0x7f594c115410 2026-02-13T01:29:50.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.208+0000 7f593a7fc6c0 1 -- 10.20.193.91:0/1499755713 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f59400a9570 con 0x7f594c115410 2026-02-13T01:29:50.208 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:50.208 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:50.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f59280b56d0 msgr2=0x7f59280d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:50.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f59280b56d0 0x7f59280d5b80 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f593c005980 tx=0x7f593c005910 comp rx=0 tx=0).stop 2026-02-13T01:29:50.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 msgr2=0x7f594c11d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:50.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c11d790 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f594000b6c0 tx=0x7f594000bb90 comp rx=0 tx=0).stop 2026-02-13T01:29:50.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 shutdown_connections 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f59280b56d0 0x7f59280d5b80 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f594c122b50 0x7f594c122ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f594c115410 0x7f594c11d790 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 --2- 10.20.193.91:0/1499755713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f594c10f200 0x7f594c11d250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 >> 10.20.193.91:0/1499755713 conn(0x7f594c0ecb00 msgr2=0x7f594c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 shutdown_connections 2026-02-13T01:29:50.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:50.209+0000 7f59537ac6c0 1 -- 10.20.193.91:0/1499755713 wait complete. 2026-02-13T01:29:50.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:50 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1499755713' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:50.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:50 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1499755713' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:50.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:50 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1499755713' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:51.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:51 trial154 ceph-mon[27045]: pgmap v322: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:51.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:51 trial091 ceph-mon[25068]: pgmap v322: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:51.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:51 trial126 ceph-mon[26569]: pgmap v322: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:53.253 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:53.374 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:53.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- 10.20.193.91:0/2864523002 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd698155760 msgr2=0x7fd698175b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:53.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- 10.20.193.91:0/2864523002 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd698155760 0x7fd698175b40 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=3694075722227850714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68c00aa40 tx=0x7fd68c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- 10.20.193.91:0/2864523002 shutdown_connections 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- 10.20.193.91:0/2864523002 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd698155760 0x7fd698175b40 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=3694075722227850714 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- 10.20.193.91:0/2864523002 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd69810c340 0x7fd698155220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- 10.20.193.91:0/2864523002 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd69810ba30 0x7fd69810be00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- 10.20.193.91:0/2864523002 >> 10.20.193.91:0/2864523002 conn(0x7fd6980e9770 msgr2=0x7fd698109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- 10.20.193.91:0/2864523002 shutdown_connections 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- 10.20.193.91:0/2864523002 wait complete. 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 Processor -- start 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- start start 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 0x7fd698160520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd69810c340 0x7fd698160a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:53.504 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd698155760 0x7fd698165e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fd698166470 con 0x7fd69810ba30 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd6981665e0 con 0x7fd69810c340 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd69de976c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6981667a0 con 0x7fd698155760 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 0x7fd698160520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 0x7fd698160520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48240/0 (socket says 10.20.193.91:48240) 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 -- 10.20.193.91:0/3327816397 learned_addr learned my addr 10.20.193.91:0/3327816397 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd696ffd6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd69810c340 0x7fd698160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd697fff6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd698155760 0x7fd698165e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 -- 10.20.193.91:0/3327816397 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd698155760 msgr2=0x7fd698165e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd698155760 0x7fd698165e20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.505 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 -- 10.20.193.91:0/3327816397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd69810c340 msgr2=0x7fd698160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd69810c340 0x7fd698160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 -- 10.20.193.91:0/3327816397 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c00a660 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.500+0000 7fd6977fe6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 0x7fd698160520 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68400b710 tx=0x7fd68400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.501+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd684004250 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.501+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd684002d80 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.501+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd698166a80 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.501+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd68400cdc0 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.501+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981523a0 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.501+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69805fb90 con 0x7fd69810ba30 2026-02-13T01:29:53.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.502+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fd6840028c0 con 0x7fd69810ba30 2026-02-13T01:29:53.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.503+0000 7fd694ff96c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd66c0b5650 0x7fd66c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:53.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.503+0000 7fd696ffd6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd66c0b5650 0x7fd66c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:53.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.503+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fd6840e3ca0 con 0x7fd69810ba30 2026-02-13T01:29:53.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.503+0000 7fd696ffd6c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd66c0b5650 0x7fd66c0d5b00 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd688005980 tx=0x7fd688005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:53.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.503+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6840aa0e0 con 0x7fd69810ba30 2026-02-13T01:29:53.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.618+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd69810be00 con 0x7fd69810ba30 2026-02-13T01:29:53.619 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:53 trial091 ceph-mon[25068]: pgmap v323: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:53.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.618+0000 7fd694ff96c0 1 -- 10.20.193.91:0/3327816397 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd6840706f0 con 0x7fd69810ba30 2026-02-13T01:29:53.620 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:53.620 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd66c0b5650 msgr2=0x7fd66c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd66c0b5650 0x7fd66c0d5b00 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd688005980 tx=0x7fd688005910 comp rx=0 tx=0).stop 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 msgr2=0x7fd698160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 0x7fd698160520 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd68400b710 tx=0x7fd68400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 shutdown_connections 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fd66c0b5650 0x7fd66c0d5b00 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fd698155760 0x7fd698165e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd69810c340 0x7fd698160a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 --2- 10.20.193.91:0/3327816397 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fd69810ba30 0x7fd698160520 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:53.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 >> 10.20.193.91:0/3327816397 conn(0x7fd6980e9770 msgr2=0x7fd698109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:53.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 shutdown_connections 2026-02-13T01:29:53.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:53.619+0000 7fd69de976c0 1 -- 10.20.193.91:0/3327816397 wait complete. 2026-02-13T01:29:53.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:53 trial154 ceph-mon[27045]: pgmap v323: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:53 trial126 ceph-mon[26569]: pgmap v323: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:54.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:54 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3327816397' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:54.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:54 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3327816397' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:54 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3327816397' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:55.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:55 trial154 ceph-mon[27045]: pgmap v324: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:55.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:55 trial091 ceph-mon[25068]: pgmap v324: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:55 trial126 ceph-mon[26569]: pgmap v324: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:29:56.662 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:29:56.780 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:29:56.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/1631962144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca8115440 msgr2=0x7f5ca8175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:56.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/1631962144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca8115440 0x7f5ca8175de0 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=5429123783002739788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c9c00aa70 tx=0x7f5c9c02fde0 comp rx=0 tx=0).stop 2026-02-13T01:29:56.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/1631962144 shutdown_connections 2026-02-13T01:29:56.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/1631962144 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca8115440 0x7f5ca8175de0 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=5429123783002739788 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:56.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/1631962144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ca810fc20 0x7f5ca8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/1631962144 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca810f230 0x7f5ca810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/1631962144 >> 10.20.193.91:0/1631962144 conn(0x7f5ca80ecb30 msgr2=0x7f5ca810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/1631962144 shutdown_connections 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/1631962144 wait complete. 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 Processor -- start 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.896+0000 7f5cae5f06c0 1 -- start start 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 0x7f5ca811d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ca8115440 0x7f5ca811d7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca8122b80 0x7f5ca8123020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8123590 con 0x7f5ca810f230 2026-02-13T01:29:56.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca8123700 con 0x7f5ca8115440 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca81238c0 con 0x7f5ca8122b80 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 0x7f5ca811d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 0x7f5ca811d280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48266/0 (socket says 10.20.193.91:48266) 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 -- 10.20.193.91:0/2300307158 learned_addr learned my addr 10.20.193.91:0/2300307158 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 -- 10.20.193.91:0/2300307158 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca8122b80 msgr2=0x7f5ca8123020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cacb666c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca8122b80 0x7f5ca8123020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca8122b80 0x7f5ca8123020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 -- 10.20.193.91:0/2300307158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ca8115440 msgr2=0x7f5ca811d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ca8115440 0x7f5ca811d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 -- 10.20.193.91:0/2300307158 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c9c00a660 con 0x7f5ca810f230 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cacb666c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca8122b80 0x7f5ca8123020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:29:56.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca7fff6c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 0x7f5ca811d280 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c94005dc0 tx=0x7f5c9400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:56.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c94004250 con 0x7f5ca810f230 2026-02-13T01:29:56.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca8163d70 con 0x7f5ca810f230 2026-02-13T01:29:56.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5c94009070 con 0x7f5ca810f230 2026-02-13T01:29:56.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c9400cd70 con 0x7f5ca810f230 2026-02-13T01:29:56.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca8164200 con 0x7f5ca810f230 2026-02-13T01:29:56.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.897+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca8110500 con 0x7f5ca810f230 2026-02-13T01:29:56.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.899+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f5c940028c0 con 0x7f5ca810f230 2026-02-13T01:29:56.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.900+0000 7f5ca57fa6c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5c7c0b5650 0x7f5c7c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:29:56.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.900+0000 7f5ca77fe6c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5c7c0b5650 0x7f5c7c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:29:56.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.900+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f5c940e3c70 con 0x7f5ca810f230 2026-02-13T01:29:56.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.900+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5c940aa0b0 con 0x7f5ca810f230 2026-02-13T01:29:56.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:56.900+0000 7f5ca77fe6c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5c7c0b5650 0x7f5c7c0d5b00 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ca8123c10 tx=0x7f5c98005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:29:57.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.012+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ca810f600 con 0x7f5ca810f230 2026-02-13T01:29:57.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.012+0000 7f5ca57fa6c0 1 -- 10.20.193.91:0/2300307158 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5c940ac120 con 0x7f5ca810f230 2026-02-13T01:29:57.013 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:29:57.013 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:29:57.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5c7c0b5650 msgr2=0x7f5c7c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5c7c0b5650 0x7f5c7c0d5b00 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ca8123c10 tx=0x7f5c98005f10 comp rx=0 tx=0).stop 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 msgr2=0x7f5ca811d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 0x7f5ca811d280 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c94005dc0 tx=0x7f5c9400bbb0 comp rx=0 tx=0).stop 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 shutdown_connections 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f5c7c0b5650 0x7f5c7c0d5b00 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f5ca8122b80 0x7f5ca8123020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ca8115440 0x7f5ca811d7c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 --2- 10.20.193.91:0/2300307158 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f5ca810f230 0x7f5ca811d280 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 >> 10.20.193.91:0/2300307158 conn(0x7f5ca80ecb30 msgr2=0x7f5ca810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 shutdown_connections 2026-02-13T01:29:57.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:29:57.013+0000 7f5cae5f06c0 1 -- 10.20.193.91:0/2300307158 wait complete. 2026-02-13T01:29:57.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:57 trial154 ceph-mon[27045]: pgmap v325: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:57.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:57 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2300307158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:57.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:57 trial091 ceph-mon[25068]: pgmap v325: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:57.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:57 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2300307158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:57.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:57 trial126 ceph-mon[26569]: pgmap v325: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:29:57.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:57 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2300307158' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:29:59.650 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:29:59 trial126 ceph-mon[26569]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:59.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:29:59 trial154 ceph-mon[27045]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:29:59.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:29:59 trial091 ceph-mon[25068]: pgmap v326: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:30:00.056 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:00.172 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2874542414 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca410f230 msgr2=0x7f9ca410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2874542414 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca410f230 0x7f9ca410f600 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=3217550216438997466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c980099a0 tx=0x7f9c9802ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2874542414 shutdown_connections 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2874542414 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9ca4115440 0x7f9ca4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2874542414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410fc20 0x7f9ca4114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2874542414 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca410f230 0x7f9ca410f600 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=3217550216438997466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2874542414 >> 10.20.193.91:0/2874542414 conn(0x7f9ca40ecb30 msgr2=0x7f9ca410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:00.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2874542414 shutdown_connections 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.296+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2874542414 wait complete. 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 Processor -- start 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 -- start start 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410f230 0x7f9ca411d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9ca4115440 0x7f9ca411d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 0x7f9ca4123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41236c0 con 0x7f9ca4122cb0 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4123830 con 0x7f9ca410f230 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca41239f0 con 0x7f9ca4115440 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 0x7f9ca4123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:00.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 0x7f9ca4123150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48272/0 (socket says 10.20.193.91:48272) 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 -- 10.20.193.91:0/2968999122 learned_addr learned my addr 10.20.193.91:0/2968999122 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca2ffd6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410f230 0x7f9ca411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca27fc6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9ca4115440 0x7f9ca411d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 -- 10.20.193.91:0/2968999122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9ca4115440 msgr2=0x7f9ca411d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9ca4115440 0x7f9ca411d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 -- 10.20.193.91:0/2968999122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410f230 msgr2=0x7f9ca411d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410f230 0x7f9ca411d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 -- 10.20.193.91:0/2968999122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c98009590 con 0x7f9ca4122cb0 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca2ffd6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410f230 0x7f9ca411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca37fe6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 0x7f9ca4123150 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c94006ea0 tx=0x7f9c9400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c94003a30 con 0x7f9ca4122cb0 2026-02-13T01:30:00.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca4163ea0 con 0x7f9ca4122cb0 2026-02-13T01:30:00.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9c940054f0 con 0x7f9ca4122cb0 2026-02-13T01:30:00.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c9400dcd0 con 0x7f9ca4122cb0 2026-02-13T01:30:00.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.297+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca4164330 con 0x7f9ca4122cb0 2026-02-13T01:30:00.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.298+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4110500 con 0x7f9ca4122cb0 2026-02-13T01:30:00.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.299+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9c94005030 con 0x7f9ca4122cb0 2026-02-13T01:30:00.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.300+0000 7f9c83fff6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9c780b5650 0x7f9c780d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:00.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.300+0000 7f9ca2ffd6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9c780b5650 0x7f9c780d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:00.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.300+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f9c940e4d40 con 0x7f9ca4122cb0 2026-02-13T01:30:00.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.300+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9c940aa6b0 con 0x7f9ca4122cb0 2026-02-13T01:30:00.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.300+0000 7f9ca2ffd6c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9c780b5650 0x7f9c780d5b00 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c98005b40 tx=0x7f9c98005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:00.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.414+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ca411e500 con 0x7f9ca4122cb0 2026-02-13T01:30:00.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.415+0000 7f9c83fff6c0 1 -- 10.20.193.91:0/2968999122 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9c940aa890 con 0x7f9ca4122cb0 2026-02-13T01:30:00.416 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:00.416 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9c780b5650 msgr2=0x7f9c780d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9c780b5650 0x7f9c780d5b00 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c98005b40 tx=0x7f9c98005c00 comp rx=0 tx=0).stop 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 msgr2=0x7f9ca4123150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 0x7f9ca4123150 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c94006ea0 tx=0x7f9c9400cca0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 shutdown_connections 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f9c780b5650 0x7f9c780d5b00 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f9ca4122cb0 0x7f9ca4123150 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f9ca4115440 0x7f9ca411d8f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 --2- 10.20.193.91:0/2968999122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ca410f230 0x7f9ca411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:00.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 >> 10.20.193.91:0/2968999122 conn(0x7f9ca40ecb30 msgr2=0x7f9ca410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:00.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 shutdown_connections 2026-02-13T01:30:00.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:00.416+0000 7f9ca97046c0 1 -- 10.20.193.91:0/2968999122 wait complete. 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial154 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp5l7lmtsg:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpmy7ai9ev:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T01:30:00.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T01:30:00.717 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: Traceback (most recent call last): 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: return _run_code(code, main_globals, None, 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: exec(code, run_globals) 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T01:30:00.718 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T01:30:00.719 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T01:30:00.719 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T01:30:00.719 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T01:30:00.719 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T01:30:00.719 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T01:30:00.719 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:00 trial154 ceph-mon[27045]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial154 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp5l7lmtsg:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpmy7ai9ev:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:00.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T01:30:00.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial154 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp5l7lmtsg:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpmy7ai9ev:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T01:30:00.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T01:30:00.730 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: Traceback (most recent call last): 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: return _run_code(code, main_globals, None, 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: exec(code, run_globals) 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T01:30:00.731 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T01:30:00.732 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T01:30:00.732 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:00 trial091 ceph-mon[25068]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial154 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp5l7lmtsg:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpmy7ai9ev:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.c/config 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial154 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp5l7lmtsg:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpmy7ai9ev:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T01:30:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T01:30:00.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: Traceback (most recent call last): 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: return _run_code(code, main_globals, None, 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: exec(code, run_globals) 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5364, in 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 5352, in main 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 398, in _infer_config 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 313, in _infer_fsid 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 426, in _infer_image 2026-02-13T01:30:00.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 300, in _validate_fsid 2026-02-13T01:30:00.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/__main__.py", line 3264, in command_ceph_volume 2026-02-13T01:30:00.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: File "/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/cephadm.af5ad72854fa0979d586dc33d05fb8a93f721c738a08a133ee06103d78368d54/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T01:30:00.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:00 trial126 ceph-mon[26569]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial154 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp5l7lmtsg:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpmy7ai9ev:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T01:30:01.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:01 trial154 ceph-mon[27045]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:01.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:01 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2968999122' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:01.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:01 trial091 ceph-mon[25068]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:01.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:01 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2968999122' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:01.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:01 trial126 ceph-mon[26569]: pgmap v327: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:01.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:01 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2968999122' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:03.457 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:03.577 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:03.635 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:03 trial091 ceph-mon[25068]: pgmap v328: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 -- 10.20.193.91:0/2668658679 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc10d970 msgr2=0x7faecc1129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2668658679 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc10d970 0x7faecc1129b0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=16514550888571514835 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faec00099a0 tx=0x7faec002ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 -- 10.20.193.91:0/2668658679 shutdown_connections 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2668658679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faecc113190 0x7faecc173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2668658679 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc10d970 0x7faecc1129b0 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=16514550888571514835 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2668658679 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faecc10cf80 0x7faecc10d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 -- 10.20.193.91:0/2668658679 >> 10.20.193.91:0/2668658679 conn(0x7faecc0ea880 msgr2=0x7faecc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:03.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 -- 10.20.193.91:0/2668658679 shutdown_connections 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.692+0000 7faed42c46c0 1 -- 10.20.193.91:0/2668658679 wait complete. 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 Processor -- start 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 -- start start 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faecc10cf80 0x7faecc060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faecc113190 0x7faecc173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 0x7faecc0610e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0626d0 con 0x7faecc060c40 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0face0 con 0x7faecc113190 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7faecc0fae70 con 0x7faecc10cf80 2026-02-13T01:30:03.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 0x7faecc0610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 0x7faecc0610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:48278/0 (socket says 10.20.193.91:48278) 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 -- 10.20.193.91:0/2180405281 learned_addr learned my addr 10.20.193.91:0/2180405281 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed18346c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faecc113190 0x7faecc173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed20356c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faecc10cf80 0x7faecc060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 -- 10.20.193.91:0/2180405281 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faecc10cf80 msgr2=0x7faecc060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faecc10cf80 0x7faecc060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 -- 10.20.193.91:0/2180405281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faecc113190 msgr2=0x7faecc173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faecc113190 0x7faecc173a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 -- 10.20.193.91:0/2180405281 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec0009590 con 0x7faecc060c40 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed28366c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 0x7faecc0610e0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faec8006ea0 tx=0x7faec800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faec8003a30 con 0x7faecc060c40 2026-02-13T01:30:03.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7faec80054f0 con 0x7faecc060c40 2026-02-13T01:30:03.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faecc0fb150 con 0x7faecc060c40 2026-02-13T01:30:03.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faec800dcd0 con 0x7faecc060c40 2026-02-13T01:30:03.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.693+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faecc0fb630 con 0x7faecc060c40 2026-02-13T01:30:03.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.694+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faecc10e250 con 0x7faecc060c40 2026-02-13T01:30:03.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.695+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7faec8005030 con 0x7faecc060c40 2026-02-13T01:30:03.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.696+0000 7faeb37fe6c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faea80b5650 0x7faea80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:03.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.696+0000 7faed20356c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faea80b5650 0x7faea80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:03.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.696+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7faec80e4c40 con 0x7faecc060c40 2026-02-13T01:30:03.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.696+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faec80aa5f0 con 0x7faecc060c40 2026-02-13T01:30:03.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.696+0000 7faed20356c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faea80b5650 0x7faea80d5b00 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faebc005980 tx=0x7faebc005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:03.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:03 trial154 ceph-mon[27045]: pgmap v328: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:03.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.809+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faecc10d350 con 0x7faecc060c40 2026-02-13T01:30:03.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.809+0000 7faeb37fe6c0 1 -- 10.20.193.91:0/2180405281 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faec80aa7d0 con 0x7faecc060c40 2026-02-13T01:30:03.811 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:03.811 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:03.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.810+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faea80b5650 msgr2=0x7faea80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:03.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faea80b5650 0x7faea80d5b00 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faebc005980 tx=0x7faebc005910 comp rx=0 tx=0).stop 2026-02-13T01:30:03.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 msgr2=0x7faecc0610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:03.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 0x7faecc0610e0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faec8006ea0 tx=0x7faec800cca0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 shutdown_connections 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7faea80b5650 0x7faea80d5b00 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7faecc060c40 0x7faecc0610e0 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faecc113190 0x7faecc173a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 --2- 10.20.193.91:0/2180405281 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7faecc10cf80 0x7faecc060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 >> 10.20.193.91:0/2180405281 conn(0x7faecc0ea880 msgr2=0x7faecc10b680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 shutdown_connections 2026-02-13T01:30:03.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:03.811+0000 7faed42c46c0 1 -- 10.20.193.91:0/2180405281 wait complete. 2026-02-13T01:30:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:03 trial126 ceph-mon[26569]: pgmap v328: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:04.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:04 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2180405281' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:04.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:04 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2180405281' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:04 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2180405281' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:05.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:05 trial154 ceph-mon[27045]: pgmap v329: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:05.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:05 trial091 ceph-mon[25068]: pgmap v329: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:05 trial126 ceph-mon[26569]: pgmap v329: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:06.853 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:06.972 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 -- 10.20.193.91:0/3813093279 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f172410f230 msgr2=0x7f172410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 --2- 10.20.193.91:0/3813093279 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f172410f230 0x7f172410f600 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=4449994545984869478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17180099a0 tx=0x7f171802ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 -- 10.20.193.91:0/3813093279 shutdown_connections 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 --2- 10.20.193.91:0/3813093279 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f1724115440 0x7f1724175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 --2- 10.20.193.91:0/3813093279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f172410fc20 0x7f1724114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 --2- 10.20.193.91:0/3813093279 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f172410f230 0x7f172410f600 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=4449994545984869478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 -- 10.20.193.91:0/3813093279 >> 10.20.193.91:0/3813093279 conn(0x7f17240ecb30 msgr2=0x7f172410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 -- 10.20.193.91:0/3813093279 shutdown_connections 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.087+0000 7f17297e36c0 1 -- 10.20.193.91:0/3813093279 wait complete. 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 Processor -- start 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 -- start start 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f172410f230 0x7f172411d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 0x7f172411d8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1724122cb0 0x7f1724123150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f17241236c0 con 0x7f1724115440 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1724123830 con 0x7f1724122cb0 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17241239f0 con 0x7f172410f230 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 0x7f172411d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 0x7f172411d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60740/0 (socket says 10.20.193.91:60740) 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 -- 10.20.193.91:0/2324559794 learned_addr learned my addr 10.20.193.91:0/2324559794 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f1722ffd6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f172410f230 0x7f172411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:07.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17237fe6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1724122cb0 0x7f1724123150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 -- 10.20.193.91:0/2324559794 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f172410f230 msgr2=0x7f172411d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f172410f230 0x7f172411d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 -- 10.20.193.91:0/2324559794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1724122cb0 msgr2=0x7f1724123150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1724122cb0 0x7f1724123150 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 -- 10.20.193.91:0/2324559794 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718009590 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f1722ffd6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f172410f230 0x7f172411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17237fe6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1724122cb0 0x7f1724123150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17227fc6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 0x7f172411d8f0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f170c005dc0 tx=0x7f170c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f170c004250 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f170c009070 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1724163ea0 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f170c00cd50 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.088+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1724164330 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.089+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1724110500 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.090+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f170c0028c0 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.090+0000 7f1703fff6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16f80b5650 0x7f16f80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.091+0000 7f1722ffd6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16f80b5650 0x7f16f80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.091+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f170c0e3c20 con 0x7f1724115440 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.091+0000 7f1722ffd6c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16f80b5650 0x7f16f80d5b00 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17180098c0 tx=0x7f171802f580 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:07.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.091+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f170c0a6600 con 0x7f1724115440 2026-02-13T01:30:07.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.207+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f172410f600 con 0x7f1724115440 2026-02-13T01:30:07.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.207+0000 7f1703fff6c0 1 -- 10.20.193.91:0/2324559794 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f170c0a97b0 con 0x7f1724115440 2026-02-13T01:30:07.207 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:07.207 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:07.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16f80b5650 msgr2=0x7f16f80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16f80b5650 0x7f16f80d5b00 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17180098c0 tx=0x7f171802f580 comp rx=0 tx=0).stop 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 msgr2=0x7f172411d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 0x7f172411d8f0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f170c005dc0 tx=0x7f170c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 shutdown_connections 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f16f80b5650 0x7f16f80d5b00 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1724122cb0 0x7f1724123150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f1724115440 0x7f172411d8f0 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 --2- 10.20.193.91:0/2324559794 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f172410f230 0x7f172411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 >> 10.20.193.91:0/2324559794 conn(0x7f17240ecb30 msgr2=0x7f172410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 shutdown_connections 2026-02-13T01:30:07.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:07.208+0000 7f17297e36c0 1 -- 10.20.193.91:0/2324559794 wait complete. 2026-02-13T01:30:07.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:07 trial091 ceph-mon[25068]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:07.478 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:07 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2324559794' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:07.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:07 trial154 ceph-mon[27045]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:07.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:07 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2324559794' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:07 trial126 ceph-mon[26569]: pgmap v330: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:07.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:07 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2324559794' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:09.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:09 trial154 ceph-mon[27045]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:30:09.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:09 trial091 ceph-mon[25068]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:30:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:09 trial126 ceph-mon[26569]: pgmap v331: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T01:30:10.252 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:10.371 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2923658309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c10f200 msgr2=0x7f0b4c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2923658309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c10f200 0x7f0b4c10f5d0 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=1135414845224757482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b380099a0 tx=0x7f0b3802ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2923658309 shutdown_connections 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2923658309 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b4c115410 0x7f0b4c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2923658309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4c10fbf0 0x7f0b4c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2923658309 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c10f200 0x7f0b4c10f5d0 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=1135414845224757482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2923658309 >> 10.20.193.91:0/2923658309 conn(0x7f0b4c0ecb00 msgr2=0x7f0b4c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2923658309 shutdown_connections 2026-02-13T01:30:10.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.494+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2923658309 wait complete. 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 Processor -- start 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 -- start start 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4c10f200 0x7f0b4c11d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 0x7f0b4c11d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b4c122c50 0x7f0b4c1230f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c123660 con 0x7f0b4c115410 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c1237d0 con 0x7f0b4c10f200 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c123990 con 0x7f0b4c122c50 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 0x7f0b4c11d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 0x7f0b4c11d890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60748/0 (socket says 10.20.193.91:60748) 2026-02-13T01:30:10.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 -- 10.20.193.91:0/2108091301 learned_addr learned my addr 10.20.193.91:0/2108091301 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4bfff6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4c10f200 0x7f0b4c11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 -- 10.20.193.91:0/2108091301 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b4c122c50 msgr2=0x7f0b4c1230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b4c122c50 0x7f0b4c1230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 -- 10.20.193.91:0/2108091301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4c10f200 msgr2=0x7f0b4c11d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4c10f200 0x7f0b4c11d350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 -- 10.20.193.91:0/2108091301 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b38009590 con 0x7f0b4c115410 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b4b7fe6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 0x7f0b4c11d890 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c005dc0 tx=0x7f0b3c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b3c004250 con 0x7f0b4c115410 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0b3c009070 con 0x7f0b4c115410 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c163e40 con 0x7f0b4c115410 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b3c00cd50 con 0x7f0b4c115410 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.495+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c164320 con 0x7f0b4c115410 2026-02-13T01:30:10.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.496+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c1104d0 con 0x7f0b4c115410 2026-02-13T01:30:10.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.497+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0b3c0028c0 con 0x7f0b4c115410 2026-02-13T01:30:10.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.498+0000 7f0b497fa6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b200b56d0 0x7f0b200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:10.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.498+0000 7f0b4bfff6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b200b56d0 0x7f0b200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:10.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.498+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f0b3c0e3bd0 con 0x7f0b4c115410 2026-02-13T01:30:10.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.498+0000 7f0b4bfff6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b200b56d0 0x7f0b200d5b80 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b380092e0 tx=0x7f0b38005c00 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:10.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.499+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b3c0a6570 con 0x7f0b4c115410 2026-02-13T01:30:10.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.619+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b4c10fbf0 con 0x7f0b4c115410 2026-02-13T01:30:10.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.619+0000 7f0b497fa6c0 1 -- 10.20.193.91:0/2108091301 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0b3c0a9720 con 0x7f0b4c115410 2026-02-13T01:30:10.620 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:10.620 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:10.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b200b56d0 msgr2=0x7f0b200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:10.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b200b56d0 0x7f0b200d5b80 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b380092e0 tx=0x7f0b38005c00 comp rx=0 tx=0).stop 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 msgr2=0x7f0b4c11d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 0x7f0b4c11d890 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b3c005dc0 tx=0x7f0b3c00bbb0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 shutdown_connections 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f0b200b56d0 0x7f0b200d5b80 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f0b4c122c50 0x7f0b4c1230f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f0b4c115410 0x7f0b4c11d890 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 --2- 10.20.193.91:0/2108091301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b4c10f200 0x7f0b4c11d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 >> 10.20.193.91:0/2108091301 conn(0x7f0b4c0ecb00 msgr2=0x7f0b4c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 shutdown_connections 2026-02-13T01:30:10.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:10.621+0000 7f0b5275c6c0 1 -- 10.20.193.91:0/2108091301 wait complete. 2026-02-13T01:30:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:11 trial154 ceph-mon[27045]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:11.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:11 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/2108091301' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:11 trial091 ceph-mon[25068]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:11.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:11 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/2108091301' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:11 trial126 ceph-mon[26569]: pgmap v332: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:11 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/2108091301' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:13.662 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:13.688 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:13 trial091 ceph-mon[25068]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:13.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:13 trial154 ceph-mon[27045]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:13.786 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:13.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:13 trial126 ceph-mon[26569]: pgmap v333: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:13.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- 10.20.193.91:0/3392377645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7500115420 msgr2=0x7f7500175dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- 10.20.193.91:0/3392377645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7500115420 0x7f7500175dc0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=2167543731995755019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74f400aa70 tx=0x7f74f402fde0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- 10.20.193.91:0/3392377645 shutdown_connections 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- 10.20.193.91:0/3392377645 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f7500115420 0x7f7500175dc0 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=2167543731995755019 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- 10.20.193.91:0/3392377645 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f750010fc00 0x7f7500114c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- 10.20.193.91:0/3392377645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f750010f210 0x7f750010f5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- 10.20.193.91:0/3392377645 >> 10.20.193.91:0/3392377645 conn(0x7f75000ecb30 msgr2=0x7f750010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- 10.20.193.91:0/3392377645 shutdown_connections 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- 10.20.193.91:0/3392377645 wait complete. 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 Processor -- start 2026-02-13T01:30:13.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- start start 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 0x7f750011d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7500115420 0x7f750011d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7500122ad0 0x7f7500122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f75001234e0 con 0x7f750010f210 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7500123650 con 0x7f7500122ad0 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75089986c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7500123810 con 0x7f7500115420 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 0x7f750011d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 0x7f750011d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:60764/0 (socket says 10.20.193.91:60764) 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 -- 10.20.193.91:0/934223595 learned_addr learned my addr 10.20.193.91:0/934223595 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f7505f086c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7500115420 0x7f750011d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f7506f0a6c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7500122ad0 0x7f7500122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 -- 10.20.193.91:0/934223595 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7500115420 msgr2=0x7f750011d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7500115420 0x7f750011d710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 -- 10.20.193.91:0/934223595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7500122ad0 msgr2=0x7f7500122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7500122ad0 0x7f7500122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 -- 10.20.193.91:0/934223595 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f400a660 con 0x7f750010f210 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.913+0000 7f75067096c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 0x7f750011d1d0 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74f800b710 tx=0x7f74f800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.914+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74f8004250 con 0x7f750010f210 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.914+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7500163cc0 con 0x7f750010f210 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.914+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f74f8002d80 con 0x7f750010f210 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.914+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74f800cdc0 con 0x7f750010f210 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.914+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7500164150 con 0x7f750010f210 2026-02-13T01:30:13.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.914+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75001104e0 con 0x7f750010f210 2026-02-13T01:30:13.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.915+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f74f80028c0 con 0x7f750010f210 2026-02-13T01:30:13.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.916+0000 7f74eb7fe6c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74dc0b5650 0x7f74dc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:13.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.916+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f74f80e3d30 con 0x7f750010f210 2026-02-13T01:30:13.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.916+0000 7f7505f086c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74dc0b5650 0x7f74dc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:13.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.916+0000 7f7505f086c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74dc0b5650 0x7f74dc0d5b00 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74ec005fd0 tx=0x7f74ec005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:13.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:13.916+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74f80a6710 con 0x7f750010f210 2026-02-13T01:30:14.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.030+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f750010fc00 con 0x7f750010f210 2026-02-13T01:30:14.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.030+0000 7f74eb7fe6c0 1 -- 10.20.193.91:0/934223595 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74f80a98c0 con 0x7f750010f210 2026-02-13T01:30:14.031 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:14.031 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:14.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74dc0b5650 msgr2=0x7f74dc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:14.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74dc0b5650 0x7f74dc0d5b00 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74ec005fd0 tx=0x7f74ec005910 comp rx=0 tx=0).stop 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 msgr2=0x7f750011d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 0x7f750011d1d0 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74f800b710 tx=0x7f74f800bbe0 comp rx=0 tx=0).stop 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 shutdown_connections 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f74dc0b5650 0x7f74dc0d5b00 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7500122ad0 0x7f7500122f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f7500115420 0x7f750011d710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 --2- 10.20.193.91:0/934223595 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f750010f210 0x7f750011d1d0 unknown :-1 s=CLOSED pgs=474 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 >> 10.20.193.91:0/934223595 conn(0x7f75000ecb30 msgr2=0x7f750010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 shutdown_connections 2026-02-13T01:30:14.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:14.031+0000 7f75089986c0 1 -- 10.20.193.91:0/934223595 wait complete. 2026-02-13T01:30:14.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:14 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/934223595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:14.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:14 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/934223595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:14.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:14 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/934223595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:15.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:15 trial154 ceph-mon[27045]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:15.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:15 trial091 ceph-mon[25068]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:15.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:15 trial126 ceph-mon[26569]: pgmap v334: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:16.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:16 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:30:16.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:16 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:30:16.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:16 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T01:30:17.076 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:17.195 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:17.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 -- 10.20.193.91:0/2995099845 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac10d970 msgr2=0x7fbbac1129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/2995099845 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac10d970 0x7fbbac1129b0 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=15132556424927425908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbba00099a0 tx=0x7fbba002ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 -- 10.20.193.91:0/2995099845 shutdown_connections 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/2995099845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbac113190 0x7fbbac173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/2995099845 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac10d970 0x7fbbac1129b0 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=15132556424927425908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/2995099845 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbbac10cf80 0x7fbbac10d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 -- 10.20.193.91:0/2995099845 >> 10.20.193.91:0/2995099845 conn(0x7fbbac0ea880 msgr2=0x7fbbac10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 -- 10.20.193.91:0/2995099845 shutdown_connections 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.312+0000 7fbbb37116c0 1 -- 10.20.193.91:0/2995099845 wait complete. 2026-02-13T01:30:17.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 Processor -- start 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 -- start start 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbbac10cf80 0x7fbbac0f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 0x7fbbac173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbac0f5300 0x7fbbac0fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0f59f0 con 0x7fbbac113190 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0faac0 con 0x7fbbac0f5300 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0fac80 con 0x7fbbac10cf80 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 0x7fbbac173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 0x7fbbac173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:39354/0 (socket says 10.20.193.91:39354) 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 -- 10.20.193.91:0/1785559345 learned_addr learned my addr 10.20.193.91:0/1785559345 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:17.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb14826c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbbac10cf80 0x7fbbac0f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb1c836c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbac0f5300 0x7fbbac0fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 -- 10.20.193.91:0/1785559345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbbac10cf80 msgr2=0x7fbbac0f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbbac10cf80 0x7fbbac0f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 -- 10.20.193.91:0/1785559345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbac0f5300 msgr2=0x7fbbac0fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbac0f5300 0x7fbbac0fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 -- 10.20.193.91:0/1785559345 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba0009590 con 0x7fbbac113190 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb0c816c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 0x7fbbac173a30 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbba00023c0 tx=0x7fbba002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbba0002ae0 con 0x7fbbac113190 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbba0002c40 con 0x7fbbac113190 2026-02-13T01:30:17.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac0faf00 con 0x7fbbac113190 2026-02-13T01:30:17.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbba00372f0 con 0x7fbbac113190 2026-02-13T01:30:17.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.313+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac0fb380 con 0x7fbbac113190 2026-02-13T01:30:17.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.314+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac10e250 con 0x7fbbac113190 2026-02-13T01:30:17.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.315+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbba0007810 con 0x7fbbac113190 2026-02-13T01:30:17.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.316+0000 7fbb9a7fc6c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbb880b5650 0x7fbb880d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:17.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.316+0000 7fbbb14826c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbb880b5650 0x7fbb880d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:17.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.316+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fbba0107d00 con 0x7fbbac113190 2026-02-13T01:30:17.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.316+0000 7fbbb14826c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbb880b5650 0x7fbb880d5b00 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb9c005980 tx=0x7fbb9c005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:17.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.316+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbba00ca6a0 con 0x7fbbac113190 2026-02-13T01:30:17.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.432+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbbac10d350 con 0x7fbbac113190 2026-02-13T01:30:17.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.432+0000 7fbb9a7fc6c0 1 -- 10.20.193.91:0/1785559345 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbba0007e60 con 0x7fbbac113190 2026-02-13T01:30:17.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:17.433 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:17.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbb880b5650 msgr2=0x7fbb880d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbb880b5650 0x7fbb880d5b00 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb9c005980 tx=0x7fbb9c005910 comp rx=0 tx=0).stop 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 msgr2=0x7fbbac173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 0x7fbbac173a30 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbba00023c0 tx=0x7fbba002fbf0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 shutdown_connections 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fbb880b5650 0x7fbb880d5b00 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbac0f5300 0x7fbbac0fa580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fbbac113190 0x7fbbac173a30 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 --2- 10.20.193.91:0/1785559345 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fbbac10cf80 0x7fbbac0f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 >> 10.20.193.91:0/1785559345 conn(0x7fbbac0ea880 msgr2=0x7fbbac1118d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 shutdown_connections 2026-02-13T01:30:17.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:17.433+0000 7fbbb37116c0 1 -- 10.20.193.91:0/1785559345 wait complete. 2026-02-13T01:30:17.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:17.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:17.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:30:17.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:30:17.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:30:17.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:30:17.466 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:17 trial154 ceph-mon[27045]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:17.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:30:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:30:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:30:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:30:17.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:17 trial091 ceph-mon[25068]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:17.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: pgmap v335: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T01:30:17.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:17.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T01:30:17.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' 2026-02-13T01:30:17.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T01:30:17.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T01:30:17.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:17 trial126 ceph-mon[26569]: from='mgr.14190 10.20.193.91:0/1213163222' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T01:30:18.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:18 trial154 ceph-mon[27045]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T01:30:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:18 trial154 ceph-mon[27045]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:30:18.716 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:18 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1785559345' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:18.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:18 trial091 ceph-mon[25068]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T01:30:18.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:18 trial091 ceph-mon[25068]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:30:18.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:18 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1785559345' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:18.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:18 trial126 ceph-mon[26569]: pgmap v336: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T01:30:18.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:18 trial126 ceph-mon[26569]: pgmap v337: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 8 op/s 2026-02-13T01:30:18.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:18 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1785559345' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:20.478 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:20.598 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:20.656 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:20 trial091 ceph-mon[25068]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:30:20.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:20 trial154 ceph-mon[27045]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3695551400 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810fbf0 msgr2=0x7fac18114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3695551400 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810fbf0 0x7fac18114c30 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=7184510086124046967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac080099a0 tx=0x7fac0802ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3695551400 shutdown_connections 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3695551400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac18115410 0x7fac18175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3695551400 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810fbf0 0x7fac18114c30 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=7184510086124046967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3695551400 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac1810f200 0x7fac1810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3695551400 >> 10.20.193.91:0/3695551400 conn(0x7fac180ecb00 msgr2=0x7fac1810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:20.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3695551400 shutdown_connections 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3695551400 wait complete. 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 Processor -- start 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- start start 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 0x7fac180f4ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac18115410 0x7fac18175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac180f5310 0x7fac180fa5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fac180f5a00 con 0x7fac1810f200 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fac180fab20 con 0x7fac18115410 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac1e7e06c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac180face0 con 0x7fac180f5310 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac17fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 0x7fac180f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac17fff6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 0x7fac180f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:39374/0 (socket says 10.20.193.91:39374) 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.717+0000 7fac17fff6c0 1 -- 10.20.193.91:0/3809841020 learned_addr learned my addr 10.20.193.91:0/3809841020 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac177fe6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac18115410 0x7fac18175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac1cd566c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac180f5310 0x7fac180fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac17fff6c0 1 -- 10.20.193.91:0/3809841020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac180f5310 msgr2=0x7fac180fa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac17fff6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac180f5310 0x7fac180fa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac17fff6c0 1 -- 10.20.193.91:0/3809841020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac18115410 msgr2=0x7fac18175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac17fff6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac18115410 0x7fac18175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac17fff6c0 1 -- 10.20.193.91:0/3809841020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac08009590 con 0x7fac1810f200 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac1cd566c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac180f5310 0x7fac180fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac17fff6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 0x7fac180f4ce0 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac0400b710 tx=0x7fac0400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:20.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac04004250 con 0x7fac1810f200 2026-02-13T01:30:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac180fafc0 con 0x7fac1810f200 2026-02-13T01:30:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fac04002d80 con 0x7fac1810f200 2026-02-13T01:30:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac0400cda0 con 0x7fac1810f200 2026-02-13T01:30:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac180fb750 con 0x7fac1810f200 2026-02-13T01:30:20.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.718+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac181104d0 con 0x7fac1810f200 2026-02-13T01:30:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.720+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fac040028c0 con 0x7fac1810f200 2026-02-13T01:30:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.721+0000 7fac157fa6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fabec0b5650 0x7fabec0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.721+0000 7fac177fe6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fabec0b5650 0x7fabec0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.721+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fac040e3c90 con 0x7fac1810f200 2026-02-13T01:30:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.721+0000 7fac177fe6c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fabec0b5650 0x7fabec0d5b00 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac08005b40 tx=0x7fac08005c20 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:20.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.721+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fac040a6630 con 0x7fac1810f200 2026-02-13T01:30:20.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.840+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fac180f5e30 con 0x7fac1810f200 2026-02-13T01:30:20.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.840+0000 7fac157fa6c0 1 -- 10.20.193.91:0/3809841020 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fac040a97e0 con 0x7fac1810f200 2026-02-13T01:30:20.842 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:20.842 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fabec0b5650 msgr2=0x7fabec0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fabec0b5650 0x7fabec0d5b00 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac08005b40 tx=0x7fac08005c20 comp rx=0 tx=0).stop 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 msgr2=0x7fac180f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 0x7fac180f4ce0 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac0400b710 tx=0x7fac0400bbe0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 shutdown_connections 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fabec0b5650 0x7fabec0d5b00 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fac180f5310 0x7fac180fa5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac18115410 0x7fac18175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 --2- 10.20.193.91:0/3809841020 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fac1810f200 0x7fac180f4ce0 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:20.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 >> 10.20.193.91:0/3809841020 conn(0x7fac180ecb00 msgr2=0x7fac1810d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:20.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 shutdown_connections 2026-02-13T01:30:20.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:20.842+0000 7fac1e7e06c0 1 -- 10.20.193.91:0/3809841020 wait complete. 2026-02-13T01:30:20.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:20 trial126 ceph-mon[26569]: pgmap v338: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:30:21.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:21 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/3809841020' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:21.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:21 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/3809841020' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:21.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:21 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/3809841020' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:22.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:22 trial154 ceph-mon[27045]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:30:22.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:22 trial091 ceph-mon[25068]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:30:22.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:22 trial126 ceph-mon[26569]: pgmap v339: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 10 op/s 2026-02-13T01:30:23.884 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:24.004 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:24.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- 10.20.193.91:0/1222908350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 msgr2=0x7fe90c155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/1222908350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c155180 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=16006096060427931036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe900009970 tx=0x7fe90002ed20 comp rx=0 tx=0).stop 2026-02-13T01:30:24.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- 10.20.193.91:0/1222908350 shutdown_connections 2026-02-13T01:30:24.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/1222908350 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe90c1556c0 0x7fe90c175aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/1222908350 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c155180 unknown :-1 s=CLOSED pgs=479 gs=1 cs=0 l=1 c_cookie=16006096060427931036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/1222908350 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe90c060740 0x7fe90c060b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- 10.20.193.91:0/1222908350 >> 10.20.193.91:0/1222908350 conn(0x7fe90c0ea8b0 msgr2=0x7fe90c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- 10.20.193.91:0/1222908350 shutdown_connections 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- 10.20.193.91:0/1222908350 wait complete. 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 Processor -- start 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- start start 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe90c060740 0x7fe90c161540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c161a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe90c1556c0 0x7fe90c166e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c167490 con 0x7fe90c061050 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c167600 con 0x7fe90c060740 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe91362c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c1677c0 con 0x7fe90c1556c0 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c161a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:39402/0 (socket says 10.20.193.91:39402) 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 -- 10.20.193.91:0/35000910 learned_addr learned my addr 10.20.193.91:0/35000910 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 -- 10.20.193.91:0/35000910 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe90c1556c0 msgr2=0x7fe90c166e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe90c1556c0 0x7fe90c166e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 -- 10.20.193.91:0/35000910 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe90c060740 msgr2=0x7fe90c161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe90c060740 0x7fe90c161540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 -- 10.20.193.91:0/35000910 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe900009590 con 0x7fe90c061050 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe910b9c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c161a80 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9000092b0 tx=0x7fe90002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.119+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe900002ba0 con 0x7fe90c061050 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.120+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe900002d00 con 0x7fe90c061050 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.120+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9000372f0 con 0x7fe90c061050 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.120+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c167a40 con 0x7fe90c061050 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.120+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c1512f0 con 0x7fe90c061050 2026-02-13T01:30:24.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.120+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c061c50 con 0x7fe90c061050 2026-02-13T01:30:24.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.122+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe900007910 con 0x7fe90c061050 2026-02-13T01:30:24.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.122+0000 7fe8fa7fc6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe8e80b56d0 0x7fe8e80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:24.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.122+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7fe900107d70 con 0x7fe90c061050 2026-02-13T01:30:24.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.122+0000 7fe91139d6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe8e80b56d0 0x7fe8e80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:24.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.122+0000 7fe91139d6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe8e80b56d0 0x7fe8e80d5b80 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8fc004750 tx=0x7fe8fc006d50 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:24.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.123+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe9000ca7a0 con 0x7fe90c061050 2026-02-13T01:30:24.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.237+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe90c060b10 con 0x7fe90c061050 2026-02-13T01:30:24.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.238+0000 7fe8fa7fc6c0 1 -- 10.20.193.91:0/35000910 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe9000cd8c0 con 0x7fe90c061050 2026-02-13T01:30:24.238 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:24.238 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.238+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe8e80b56d0 msgr2=0x7fe8e80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.238+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe8e80b56d0 0x7fe8e80d5b80 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8fc004750 tx=0x7fe8fc006d50 comp rx=0 tx=0).stop 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.238+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 msgr2=0x7fe90c161a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.238+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c161a80 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9000092b0 tx=0x7fe90002fd40 comp rx=0 tx=0).stop 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.238+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 shutdown_connections 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7fe8e80b56d0 0x7fe8e80d5b80 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7fe90c1556c0 0x7fe90c166e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7fe90c061050 0x7fe90c161a80 unknown :-1 s=CLOSED pgs=480 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 --2- 10.20.193.91:0/35000910 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe90c060740 0x7fe90c161540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 >> 10.20.193.91:0/35000910 conn(0x7fe90c0ea8b0 msgr2=0x7fe90c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 shutdown_connections 2026-02-13T01:30:24.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:24.239+0000 7fe91362c6c0 1 -- 10.20.193.91:0/35000910 wait complete. 2026-02-13T01:30:24.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:24 trial154 ceph-mon[27045]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:30:24.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:24 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/35000910' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:24.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:24 trial091 ceph-mon[25068]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:30:24.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:24 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/35000910' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:24.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:24 trial126 ceph-mon[26569]: pgmap v340: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:30:24.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:24 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/35000910' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:26.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:26 trial154 ceph-mon[27045]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:30:26.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:26 trial091 ceph-mon[25068]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:30:26.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:26 trial126 ceph-mon[26569]: pgmap v341: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T01:30:27.280 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:27.400 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:27.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 -- 10.20.193.91:0/419803019 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6414115410 msgr2=0x7f6414175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/419803019 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6414115410 0x7f6414175db0 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=4600415620366838685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f641000aa70 tx=0x7f641002fde0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 -- 10.20.193.91:0/419803019 shutdown_connections 2026-02-13T01:30:27.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/419803019 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f6414115410 0x7f6414175db0 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=4600415620366838685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/419803019 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f641410fbf0 0x7f6414114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/419803019 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f641410f200 0x7f641410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.515+0000 7f641bedc6c0 1 -- 10.20.193.91:0/419803019 >> 10.20.193.91:0/419803019 conn(0x7f64140ecb00 msgr2=0x7f641410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- 10.20.193.91:0/419803019 shutdown_connections 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- 10.20.193.91:0/419803019 wait complete. 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 Processor -- start 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- start start 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 0x7f641411d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6414115410 0x7f641411d710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6414122ad0 0x7f6414122f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f64141234e0 con 0x7f641410f200 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6414123650 con 0x7f6414122ad0 2026-02-13T01:30:27.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6414123810 con 0x7f6414115410 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 0x7f641411d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 0x7f641411d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36142/0 (socket says 10.20.193.91:36142) 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 -- 10.20.193.91:0/4024146926 learned_addr learned my addr 10.20.193.91:0/4024146926 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641a44e6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6414122ad0 0x7f6414122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 -- 10.20.193.91:0/4024146926 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6414115410 msgr2=0x7f641411d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641944c6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6414115410 0x7f641411d710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6414115410 0x7f641411d710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 -- 10.20.193.91:0/4024146926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6414122ad0 msgr2=0x7f6414122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6414122ad0 0x7f6414122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 -- 10.20.193.91:0/4024146926 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641000a660 con 0x7f641410f200 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641944c6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6414115410 0x7f641411d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T01:30:27.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6419c4d6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 0x7f641411d1d0 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6404009490 tx=0x7f640400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6404004a80 con 0x7f641410f200 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6414163cc0 con 0x7f641410f200 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6404009030 con 0x7f641410f200 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f640400cdd0 con 0x7f641410f200 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.516+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6414164150 con 0x7f641410f200 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.517+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64141104d0 con 0x7f641410f200 2026-02-13T01:30:27.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.518+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6404005000 con 0x7f641410f200 2026-02-13T01:30:27.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.519+0000 7f6402ffd6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63f00b5650 0x7f63f00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:27.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.519+0000 7f641944c6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63f00b5650 0x7f63f00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:27.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.519+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f64040e3cf0 con 0x7f641410f200 2026-02-13T01:30:27.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.519+0000 7f641944c6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63f00b5650 0x7f63f00d5b00 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6414123b60 tx=0x7f6408005f10 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:27.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.520+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f64040a66d0 con 0x7f641410f200 2026-02-13T01:30:27.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.634+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f641410f5d0 con 0x7f641410f200 2026-02-13T01:30:27.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.634+0000 7f6402ffd6c0 1 -- 10.20.193.91:0/4024146926 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f64040a9880 con 0x7f641410f200 2026-02-13T01:30:27.635 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:27.635 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63f00b5650 msgr2=0x7f63f00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63f00b5650 0x7f63f00d5b00 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6414123b60 tx=0x7f6408005f10 comp rx=0 tx=0).stop 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 msgr2=0x7f641411d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 0x7f641411d1d0 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6404009490 tx=0x7f640400bc50 comp rx=0 tx=0).stop 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 shutdown_connections 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f63f00b5650 0x7f63f00d5b00 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6414122ad0 0x7f6414122f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f6414115410 0x7f641411d710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 --2- 10.20.193.91:0/4024146926 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f641410f200 0x7f641411d1d0 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:27.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 >> 10.20.193.91:0/4024146926 conn(0x7f64140ecb00 msgr2=0x7f641410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:27.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 shutdown_connections 2026-02-13T01:30:27.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:27.635+0000 7f641bedc6c0 1 -- 10.20.193.91:0/4024146926 wait complete. 2026-02-13T01:30:28.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:28 trial154 ceph-mon[27045]: pgmap v342: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:30:28.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:28 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/4024146926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:28.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:28 trial091 ceph-mon[25068]: pgmap v342: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:30:28.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:28 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/4024146926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:28.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:28 trial126 ceph-mon[26569]: pgmap v342: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T01:30:28.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:28 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/4024146926' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:30.675 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph health --format=json 2026-02-13T01:30:30.700 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:30 trial091 ceph-mon[25068]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:30.715 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:30 trial154 ceph-mon[27045]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:30.794 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:30.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:30 trial126 ceph-mon[26569]: pgmap v343: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/4278515417 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164115440 msgr2=0x7f4164175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/4278515417 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164115440 0x7f4164175de0 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=10081169435316244114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f416000aa70 tx=0x7f416002fde0 comp rx=0 tx=0).stop 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/4278515417 shutdown_connections 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/4278515417 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164115440 0x7f4164175de0 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=10081169435316244114 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/4278515417 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f416410fc20 0x7f4164114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/4278515417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416410f230 0x7f416410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/4278515417 >> 10.20.193.91:0/4278515417 conn(0x7f41640ecb30 msgr2=0x7f416410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:30.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/4278515417 shutdown_connections 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/4278515417 wait complete. 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.917+0000 7f416bb3c6c0 1 Processor -- start 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- start start 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 --2- >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f416410f230 0x7f416411d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4164115440 0x7f416411d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 0x7f4164122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_getmap magic: 0 -- 0x7f41641234f0 con 0x7f4164122ae0 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4164123660 con 0x7f4164115440 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- --> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4164123820 con 0x7f416410f230 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 0x7f4164122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:30.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 --2- >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 0x7f4164122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.91:3300/0 says I am v2:10.20.193.91:36152/0 (socket says 10.20.193.91:36152) 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 -- 10.20.193.91:0/1861961535 learned_addr learned my addr 10.20.193.91:0/1861961535 (peer_addr_for_me v2:10.20.193.91:0/0) 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f41698ad6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f416410f230 0x7f416411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 -- 10.20.193.91:0/1861961535 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f416410f230 msgr2=0x7f416411d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f416410f230 0x7f416411d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 -- 10.20.193.91:0/1861961535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4164115440 msgr2=0x7f416411d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4164115440 0x7f416411d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 -- 10.20.193.91:0/1861961535 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416000a660 con 0x7f4164122ae0 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416a0ae6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 0x7f4164122f80 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41600054b0 tx=0x7f41600054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4160003a30 con 0x7f4164122ae0 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4160003b90 con 0x7f4164122ae0 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4164163c70 con 0x7f4164122ae0 2026-02-13T01:30:30.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f41600382f0 con 0x7f4164122ae0 2026-02-13T01:30:30.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41641640a0 con 0x7f4164122ae0 2026-02-13T01:30:30.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.918+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164110500 con 0x7f4164122ae0 2026-02-13T01:30:30.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.920+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4160008260 con 0x7f4164122ae0 2026-02-13T01:30:30.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.920+0000 7f4152ffd6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f41400b56d0 0x7f41400d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T01:30:30.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.920+0000 7f41698ad6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f41400b56d0 0x7f41400d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T01:30:30.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.920+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8238+0+0 (secure 0 0 0) 0x7f4160108fa0 con 0x7f4164122ae0 2026-02-13T01:30:30.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.920+0000 7f41698ad6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f41400b56d0 0x7f41400d5b80 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4154005fd0 tx=0x7f4154005910 comp rx=0 tx=0).ready entity=mgr.14190 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T01:30:30.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:30.920+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f41600cb940 con 0x7f4164122ae0 2026-02-13T01:30:31.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.040+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 --> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f416410f600 con 0x7f4164122ae0 2026-02-13T01:30:31.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.041+0000 7f4152ffd6c0 1 -- 10.20.193.91:0/1861961535 <== mon.0 v2:10.20.193.91:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f41600ceaf0 con 0x7f4164122ae0 2026-02-13T01:30:31.041 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-13T01:30:31.041 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T01:30:31.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f41400b56d0 msgr2=0x7f41400d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f41400b56d0 0x7f41400d5b80 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4154005fd0 tx=0x7f4154005910 comp rx=0 tx=0).stop 2026-02-13T01:30:31.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 msgr2=0x7f4164122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T01:30:31.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 0x7f4164122f80 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f41600054b0 tx=0x7f41600054e0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 shutdown_connections 2026-02-13T01:30:31.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:6800/3278861816,v1:10.20.193.91:6801/3278861816] conn(0x7f41400b56d0 0x7f41400d5b80 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.91:3300/0,v1:10.20.193.91:6789/0] conn(0x7f4164122ae0 0x7f4164122f80 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4164115440 0x7f416411d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 --2- 10.20.193.91:0/1861961535 >> [v2:10.20.193.154:3300/0,v1:10.20.193.154:6789/0] conn(0x7f416410f230 0x7f416411d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T01:30:31.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 >> 10.20.193.91:0/1861961535 conn(0x7f41640ecb30 msgr2=0x7f416410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T01:30:31.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 shutdown_connections 2026-02-13T01:30:31.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-13T01:30:31.042+0000 7f416bb3c6c0 1 -- 10.20.193.91:0/1861961535 wait complete. 2026-02-13T01:30:31.083 INFO:tasks.cephadm:Teardown begin 2026-02-13T01:30:31.083 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T01:30:31.091 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:30:31.148 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:30:31.179 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:30:31.210 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T01:30:31.210 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7155d718-087a-11f1-982a-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T01:30:31.326 INFO:teuthology.orchestra.run.trial091.stderr:Inferring config /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/mon.a/config 2026-02-13T01:30:31.344 INFO:teuthology.orchestra.run.trial091.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T01:30:31.363 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T01:30:31.363 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T01:30:31.364 DEBUG:teuthology.orchestra.run.trial091:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:30:31.380 DEBUG:teuthology.orchestra.run.trial126:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:30:31.397 DEBUG:teuthology.orchestra.run.trial154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T01:30:31.413 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T01:30:31.414 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T01:30:31.414 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a 2026-02-13T01:30:31.465 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:31 trial154 ceph-mon[27045]: from='client.? 10.20.193.91:0/1861961535' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:31 trial126 ceph-mon[26569]: from='client.? 10.20.193.91:0/1861961535' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:31.728 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:31 trial091 ceph-mon[25068]: from='client.? 10.20.193.91:0/1861961535' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T01:30:31.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:31 trial091 systemd[1]: Stopping Ceph mon.a for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:31.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:31 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a[25064]: 2026-02-13T01:30:31.520+0000 7ff675d856c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:31.729 INFO:journalctl@ceph.mon.a.trial091.stdout:Feb 13 01:30:31 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-a[25064]: 2026-02-13T01:30:31.520+0000 7ff675d856c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T01:30:31.871 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.a.service' 2026-02-13T01:30:31.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:31.910 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T01:30:31.910 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T01:30:31.910 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.b 2026-02-13T01:30:32.209 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:31 trial126 systemd[1]: Stopping Ceph mon.b for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:32.209 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-b[26565]: 2026-02-13T01:30:32.011+0000 7fa4b316a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:32.209 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-b[26565]: 2026-02-13T01:30:32.011+0000 7fa4b316a6c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-13T01:30:32.209 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:32 trial126 podman[58745]: 2026-02-13 01:30:32.144677783 +0000 UTC m=+0.144844435 container died df3d0d6b38a6034dd27572623eeb9e9a1d27855874fc44c053b7de407befceb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-b, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:32.210 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:32 trial126 podman[58745]: 2026-02-13 01:30:32.153848006 +0000 UTC m=+0.154014658 container remove df3d0d6b38a6034dd27572623eeb9e9a1d27855874fc44c053b7de407befceb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-b, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, version=10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.title=rockylinux) 2026-02-13T01:30:32.210 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 13 01:30:32 trial126 bash[58745]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-b 2026-02-13T01:30:32.229 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.b.service' 2026-02-13T01:30:32.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:32.268 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T01:30:32.268 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T01:30:32.268 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.c 2026-02-13T01:30:32.555 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:32 trial154 systemd[1]: Stopping Ceph mon.c for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:32.555 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-c[27041]: 2026-02-13T01:30:32.369+0000 7f26efbac6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:30:32.555 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-c[27041]: 2026-02-13T01:30:32.369+0000 7f26efbac6c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-13T01:30:32.555 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:32 trial154 podman[60486]: 2026-02-13 01:30:32.481873456 +0000 UTC m=+0.124835264 container died d0ab3a35179cb12f7f88af977f688ffcccef2687bd515611c7ce4f0d10314468 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-c, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux) 2026-02-13T01:30:32.555 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:32 trial154 podman[60486]: 2026-02-13 01:30:32.491489769 +0000 UTC m=+0.134451557 container remove d0ab3a35179cb12f7f88af977f688ffcccef2687bd515611c7ce4f0d10314468 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-c, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause) 2026-02-13T01:30:32.555 INFO:journalctl@ceph.mon.c.trial154.stdout:Feb 13 01:30:32 trial154 bash[60486]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-mon-c 2026-02-13T01:30:32.575 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mon.c.service' 2026-02-13T01:30:32.613 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:32.613 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T01:30:32.614 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T01:30:32.614 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x 2026-02-13T01:30:32.843 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.x.service' 2026-02-13T01:30:32.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:32.878 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T01:30:32.878 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T01:30:32.879 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.y 2026-02-13T01:30:32.989 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 13 01:30:32 trial126 systemd[1]: Stopping Ceph mgr.y for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:33.078 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.y.service' 2026-02-13T01:30:33.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:33.113 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T01:30:33.114 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T01:30:33.114 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.z 2026-02-13T01:30:33.306 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mgr.z.service' 2026-02-13T01:30:33.340 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:33.341 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T01:30:33.341 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T01:30:33.341 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.0 2026-02-13T01:30:33.728 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:33 trial091 systemd[1]: Stopping Ceph osd.0 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:33.728 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:33 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0[38787]: 2026-02-13T01:30:33.434+0000 7f422ca796c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:33.728 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:33 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0[38787]: 2026-02-13T01:30:33.434+0000 7f422ca796c0 -1 osd.0 77 *** Got signal Terminated *** 2026-02-13T01:30:33.728 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:33 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0[38787]: 2026-02-13T01:30:33.434+0000 7f422ca796c0 -1 osd.0 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82577]: 2026-02-13 01:30:38.503700873 +0000 UTC m=+5.081170412 container died f95be8fe0a0b08106c8d40eb23fdd80b3e32aff2df61424ead5cc259d5f80573 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, io.buildah.version=1.33.7, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux) 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82577]: 2026-02-13 01:30:38.51230174 +0000 UTC m=+5.089771269 container remove f95be8fe0a0b08106c8d40eb23fdd80b3e32aff2df61424ead5cc259d5f80573 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, license=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10) 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 bash[82577]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82712]: 2026-02-13 01:30:38.640531522 +0000 UTC m=+0.016253527 container create eb01b22c6d5c5f8ee290a8f08f0cc9db928422dbf523bf42f4e2c4a182e4f389 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82712]: 2026-02-13 01:30:38.666778049 +0000 UTC m=+0.042499994 container init eb01b22c6d5c5f8ee290a8f08f0cc9db928422dbf523bf42f4e2c4a182e4f389 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0-deactivate, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, license=BSD-3-Clause, version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82712]: 2026-02-13 01:30:38.669302693 +0000 UTC m=+0.045024638 container start eb01b22c6d5c5f8ee290a8f08f0cc9db928422dbf523bf42f4e2c4a182e4f389 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, io.buildah.version=1.33.7, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82712]: 2026-02-13 01:30:38.670014133 +0000 UTC m=+0.045736078 container attach eb01b22c6d5c5f8ee290a8f08f0cc9db928422dbf523bf42f4e2c4a182e4f389 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82712]: 2026-02-13 01:30:38.634180579 +0000 UTC m=+0.009902524 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:38.787 INFO:journalctl@ceph.osd.0.trial091.stdout:Feb 13 01:30:38 trial091 podman[82712]: 2026-02-13 01:30:38.787544724 +0000 UTC m=+0.163266679 container died eb01b22c6d5c5f8ee290a8f08f0cc9db928422dbf523bf42f4e2c4a182e4f389 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:30:38.833 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.0.service' 2026-02-13T01:30:38.867 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:38.867 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T01:30:38.867 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T01:30:38.867 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.1 2026-02-13T01:30:39.348 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:38 trial126 systemd[1]: Stopping Ceph osd.1 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:39.348 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:38 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1[32375]: 2026-02-13T01:30:38.965+0000 7ff1ab8066c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:39.348 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:38 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1[32375]: 2026-02-13T01:30:38.965+0000 7ff1ab8066c0 -1 osd.1 77 *** Got signal Terminated *** 2026-02-13T01:30:39.348 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:38 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1[32375]: 2026-02-13T01:30:38.965+0000 7ff1ab8066c0 -1 osd.1 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:44.349 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59067]: 2026-02-13 01:30:44.045349744 +0000 UTC m=+5.091894668 container died d918eb3e4a79f1c6f6bc7806585ba6cd575b21719866da484d1228b207722281 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1, ceph=True, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T01:30:44.349 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59067]: 2026-02-13 01:30:44.05562195 +0000 UTC m=+5.102166874 container remove d918eb3e4a79f1c6f6bc7806585ba6cd575b21719866da484d1228b207722281 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default) 2026-02-13T01:30:44.349 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 bash[59067]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1 2026-02-13T01:30:44.349 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59201]: 2026-02-13 01:30:44.19806402 +0000 UTC m=+0.016604298 container create 64a42113c36cb573b2f8deb79f91173951c58efb9d73ab45e61ed40acccc8005 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1-deactivate, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:44.349 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59201]: 2026-02-13 01:30:44.226395581 +0000 UTC m=+0.044935859 container init 64a42113c36cb573b2f8deb79f91173951c58efb9d73ab45e61ed40acccc8005 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, version=10) 2026-02-13T01:30:44.350 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59201]: 2026-02-13 01:30:44.229004177 +0000 UTC m=+0.047544456 container start 64a42113c36cb573b2f8deb79f91173951c58efb9d73ab45e61ed40acccc8005 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10) 2026-02-13T01:30:44.350 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59201]: 2026-02-13 01:30:44.229528309 +0000 UTC m=+0.048068587 container attach 64a42113c36cb573b2f8deb79f91173951c58efb9d73ab45e61ed40acccc8005 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-1-deactivate, summary=Rocky Linux Base image, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:30:44.350 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 13 01:30:44 trial126 podman[59201]: 2026-02-13 01:30:44.191703507 +0000 UTC m=+0.010243785 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:44.390 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.1.service' 2026-02-13T01:30:44.428 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:44.428 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T01:30:44.428 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T01:30:44.428 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.2 2026-02-13T01:30:44.715 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:44 trial154 systemd[1]: Stopping Ceph osd.2 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:44.715 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:44 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2[33155]: 2026-02-13T01:30:44.522+0000 7fda86cac6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:44.716 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:44 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2[33155]: 2026-02-13T01:30:44.522+0000 7fda86cac6c0 -1 osd.2 77 *** Got signal Terminated *** 2026-02-13T01:30:44.716 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:44 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2[33155]: 2026-02-13T01:30:44.522+0000 7fda86cac6c0 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:49.894 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60798]: 2026-02-13 01:30:49.592517526 +0000 UTC m=+5.081840511 container died 98abaf10d87593bcd581e7e78bc2f737e72b2cba5c68e0a865c04ef7eec5c303 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:49.894 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60798]: 2026-02-13 01:30:49.601452603 +0000 UTC m=+5.090775598 container remove 98abaf10d87593bcd581e7e78bc2f737e72b2cba5c68e0a865c04ef7eec5c303 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:49.894 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 bash[60798]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2 2026-02-13T01:30:49.895 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60931]: 2026-02-13 01:30:49.734580605 +0000 UTC m=+0.015177465 container create f376ef642a69b4157dc5bec378ada78a7794809a8b1ea3d52f063a93afa892d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, license=BSD-3-Clause, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:30:49.895 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60931]: 2026-02-13 01:30:49.764283483 +0000 UTC m=+0.044880353 container init f376ef642a69b4157dc5bec378ada78a7794809a8b1ea3d52f063a93afa892d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2-deactivate, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.version=10, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:30:49.895 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60931]: 2026-02-13 01:30:49.766666043 +0000 UTC m=+0.047262913 container start f376ef642a69b4157dc5bec378ada78a7794809a8b1ea3d52f063a93afa892d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image) 2026-02-13T01:30:49.895 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60931]: 2026-02-13 01:30:49.767138528 +0000 UTC m=+0.047735408 container attach f376ef642a69b4157dc5bec378ada78a7794809a8b1ea3d52f063a93afa892d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2-deactivate, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, ceph=True, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause) 2026-02-13T01:30:49.895 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60931]: 2026-02-13 01:30:49.728526621 +0000 UTC m=+0.009123502 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:49.895 INFO:journalctl@ceph.osd.2.trial154.stdout:Feb 13 01:30:49 trial154 podman[60931]: 2026-02-13 01:30:49.893201994 +0000 UTC m=+0.173798864 container died f376ef642a69b4157dc5bec378ada78a7794809a8b1ea3d52f063a93afa892d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-2-deactivate, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10) 2026-02-13T01:30:49.934 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.2.service' 2026-02-13T01:30:49.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:49.973 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T01:30:49.973 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T01:30:49.973 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.3 2026-02-13T01:30:50.478 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:50 trial091 systemd[1]: Stopping Ceph osd.3 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:50.478 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:50 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3[45177]: 2026-02-13T01:30:50.069+0000 7fa5007746c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:50.478 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:50 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3[45177]: 2026-02-13T01:30:50.069+0000 7fa5007746c0 -1 osd.3 77 *** Got signal Terminated *** 2026-02-13T01:30:50.478 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:50 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3[45177]: 2026-02-13T01:30:50.069+0000 7fa5007746c0 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82845]: 2026-02-13 01:30:55.138999387 +0000 UTC m=+5.081419547 container died 0fece891ed3c1b1b02399cc00f21f264b05d9a679d646d17383907031a512d80 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, io.buildah.version=1.33.7) 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82845]: 2026-02-13 01:30:55.148024813 +0000 UTC m=+5.090444973 container remove 0fece891ed3c1b1b02399cc00f21f264b05d9a679d646d17383907031a512d80 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3, vendor=Rocky Enterprise Software Foundation, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, name=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 bash[82845]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82986]: 2026-02-13 01:30:55.275775896 +0000 UTC m=+0.015953932 container create 9eee184b4b8d07965540c933ce10986040ceb8dbadf267f6faf559c405be3291 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3-deactivate, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux) 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82986]: 2026-02-13 01:30:55.304497455 +0000 UTC m=+0.044675430 container init 9eee184b4b8d07965540c933ce10986040ceb8dbadf267f6faf559c405be3291 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause) 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82986]: 2026-02-13 01:30:55.307193317 +0000 UTC m=+0.047371292 container start 9eee184b4b8d07965540c933ce10986040ceb8dbadf267f6faf559c405be3291 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3-deactivate, summary=Rocky Linux Base image, version=10, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82986]: 2026-02-13 01:30:55.307752554 +0000 UTC m=+0.047930520 container attach 9eee184b4b8d07965540c933ce10986040ceb8dbadf267f6faf559c405be3291 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3-deactivate, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, OSD_FLAVOR=default, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82986]: 2026-02-13 01:30:55.269630975 +0000 UTC m=+0.009808950 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:30:55.439 INFO:journalctl@ceph.osd.3.trial091.stdout:Feb 13 01:30:55 trial091 podman[82986]: 2026-02-13 01:30:55.43965465 +0000 UTC m=+0.179832625 container died 9eee184b4b8d07965540c933ce10986040ceb8dbadf267f6faf559c405be3291 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T01:30:55.471 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.3.service' 2026-02-13T01:30:55.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:30:55.506 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T01:30:55.506 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T01:30:55.506 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.4 2026-02-13T01:30:55.848 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:30:55 trial126 systemd[1]: Stopping Ceph osd.4 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:30:55.848 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:30:55 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4[38608]: 2026-02-13T01:30:55.605+0000 7f0ecc2bd6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:30:55.848 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:30:55 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4[38608]: 2026-02-13T01:30:55.605+0000 7f0ecc2bd6c0 -1 osd.4 77 *** Got signal Terminated *** 2026-02-13T01:30:55.848 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:30:55 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4[38608]: 2026-02-13T01:30:55.605+0000 7f0ecc2bd6c0 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:30:59.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:30:58 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:30:58.821+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:30:59.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:30:59 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:30:59.130+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:30:59.965 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:30:59 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:30:59.480+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:00.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:30:59 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:30:59.843+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:00.228 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:30:59 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:30:59.762+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:00.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:00 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:00.147+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:00 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:00.807+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59335]: 2026-02-13 01:31:00.6649705 +0000 UTC m=+5.071650882 container died 415f0af5084f9228a30c5a63228005da7fb92cf9e494b5c8830c9ceb60c457fc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.version=10, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59335]: 2026-02-13 01:31:00.673814127 +0000 UTC m=+5.080494499 container remove 415f0af5084f9228a30c5a63228005da7fb92cf9e494b5c8830c9ceb60c457fc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, version=10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 bash[59335]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59466]: 2026-02-13 01:31:00.799750563 +0000 UTC m=+0.015796240 container create 48f1827cb07a89a752f41b0de6ec472197fc7d386bd3184c7fd06f00f4debc49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4-deactivate, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, license=BSD-3-Clause) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59466]: 2026-02-13 01:31:00.830860255 +0000 UTC m=+0.046905932 container init 48f1827cb07a89a752f41b0de6ec472197fc7d386bd3184c7fd06f00f4debc49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.title=rockylinux, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59466]: 2026-02-13 01:31:00.833204742 +0000 UTC m=+0.049250419 container start 48f1827cb07a89a752f41b0de6ec472197fc7d386bd3184c7fd06f00f4debc49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4-deactivate, version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, ceph=True, org.opencontainers.image.version=10, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59466]: 2026-02-13 01:31:00.833660467 +0000 UTC m=+0.049706144 container attach 48f1827cb07a89a752f41b0de6ec472197fc7d386bd3184c7fd06f00f4debc49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59466]: 2026-02-13 01:31:00.793191932 +0000 UTC m=+0.009237619 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:00.955 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 13 01:31:00 trial126 podman[59466]: 2026-02-13 01:31:00.955171667 +0000 UTC m=+0.171217354 container died 48f1827cb07a89a752f41b0de6ec472197fc7d386bd3184c7fd06f00f4debc49 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:31:00.965 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:00 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:00.476+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:00.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:00 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:00.721+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:00.984 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.4.service' 2026-02-13T01:31:01.020 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:01.020 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T01:31:01.020 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T01:31:01.020 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.5 2026-02-13T01:31:01.446 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:01.107+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:01.446 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:01 trial154 systemd[1]: Stopping Ceph osd.5 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:01.446 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:01.120+0000 7fa16ff6f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:01.446 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:01.120+0000 7fa16ff6f6c0 -1 osd.5 77 *** Got signal Terminated *** 2026-02-13T01:31:01.446 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:01.120+0000 7fa16ff6f6c0 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:01.446 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:01.445+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:01.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:01 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:01.726+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:01.978 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:01 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:01.845+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:02.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:01 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:01.830+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:02.457 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:02 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:02.088+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:02.457 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:02 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:02.282+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:02.715 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:02 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:02.456+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:02.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:02 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:02.685+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:02.978 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:02 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:02.883+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:03.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:02 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:02.830+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:03.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:03 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:03.061+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:03.465 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:03 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:03.282+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:03.965 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:03 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:03.495+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:03.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:03 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:03.655+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:03.978 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:03 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:03.889+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:04.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:03 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:03.836+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:04.465 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:04 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:04.327+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:04.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:04 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:04.095+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:04.922 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:04 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:04.628+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:04.965 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:04 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:04.516+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:05.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:04 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:04.798+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:05.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:04 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:04.923+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:05.358 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:05 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:05.060+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:05.358 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:05 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:05.060+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:05.715 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:05 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5[39559]: 2026-02-13T01:31:05.544+0000 7fa16862c6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.568325+0000 front 2026-02-13T01:30:34.568337+0000 (oldest deadline 2026-02-13T01:30:59.268410+0000) 2026-02-13T01:31:05.716 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:05 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:05.356+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:05.944 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:05 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:05.631+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:06.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:05 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:05.803+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:06.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:05 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:05.943+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:06.314 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:06 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:06.311+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:06.315 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:06 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:06.019+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:06.315 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:06 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:06.019+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:06.315 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61061]: 2026-02-13 01:31:06.189756557 +0000 UTC m=+5.081363461 container died 3188c5e9c16eb8c9846b5d4ebee3b1567c3e7bd4cac9951ecaa4945f4ee7167e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, version=10, license=BSD-3-Clause, org.opencontainers.image.version=10) 2026-02-13T01:31:06.315 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61061]: 2026-02-13 01:31:06.198771164 +0000 UTC m=+5.090378068 container remove 3188c5e9c16eb8c9846b5d4ebee3b1567c3e7bd4cac9951ecaa4945f4ee7167e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, io.buildah.version=1.33.7, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-13T01:31:06.315 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 bash[61061]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5 2026-02-13T01:31:06.553 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.5.service' 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.349377938 +0000 UTC m=+0.015003941 container create 40b4dadc8700217ed16e25ab31efe5102b55c319144cbdd358c16720070979c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.374067189 +0000 UTC m=+0.039693132 container init 40b4dadc8700217ed16e25ab31efe5102b55c319144cbdd358c16720070979c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, version=10) 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.376447064 +0000 UTC m=+0.042073007 container start 40b4dadc8700217ed16e25ab31efe5102b55c319144cbdd358c16720070979c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5-deactivate, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , version=10, ceph=True, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.376915381 +0000 UTC m=+0.042541354 container attach 40b4dadc8700217ed16e25ab31efe5102b55c319144cbdd358c16720070979c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, ceph=True, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , version=10, license=BSD-3-Clause) 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.343668559 +0000 UTC m=+0.009294512 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.512198508 +0000 UTC m=+0.177824462 container died 40b4dadc8700217ed16e25ab31efe5102b55c319144cbdd358c16720070979c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, ceph=True, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7) 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 podman[61196]: 2026-02-13 01:31:06.522870929 +0000 UTC m=+0.188496872 container remove 40b4dadc8700217ed16e25ab31efe5102b55c319144cbdd358c16720070979c5 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-5-deactivate, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, name=rockylinux, version=10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:31:06.577 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 systemd[1]: ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.5.service: Deactivated successfully. 2026-02-13T01:31:06.578 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 systemd[1]: Stopped Ceph osd.5 for 7155d718-087a-11f1-982a-d404e6e7d460. 2026-02-13T01:31:06.578 INFO:journalctl@ceph.osd.5.trial154.stdout:Feb 13 01:31:06 trial154 systemd[1]: ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.5.service: Consumed 2.375s CPU time. 2026-02-13T01:31:06.590 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:06.591 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T01:31:06.591 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T01:31:06.591 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.6 2026-02-13T01:31:06.914 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:06.914+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:06.914 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:06.914+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:06.915 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:06 trial091 systemd[1]: Stopping Ceph osd.6 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:06.915 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:06.641+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:06.915 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:06.691+0000 7f20730d66c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:06.915 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:06.691+0000 7f20730d66c0 -1 osd.6 77 *** Got signal Terminated *** 2026-02-13T01:31:06.915 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:06 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:06.691+0000 7f20730d66c0 -1 osd.6 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:07.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:06 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:06.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:07.279 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:07 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:07.017+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:07.280 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:07 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:07.017+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:07.598 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:07 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:07.133+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:07.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:07 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:07.277+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:07.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:07 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:07.681+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:07.978 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:07 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:07.889+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:07.979 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:07 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:07.889+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:08.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:07 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:07.715+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:08.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:07 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:07.715+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:08.320 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:07 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:07.977+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:08.320 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:07 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:07.977+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:08.598 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:08 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:08.098+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:08.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:08 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:08.319+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:08.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:08 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:08.319+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:08.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:08 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:08.716+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:08.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:08 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:08.716+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.859860+0000 front 2026-02-13T01:30:43.859940+0000 (oldest deadline 2026-02-13T01:31:08.559891+0000) 2026-02-13T01:31:08.978 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:08 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:08.920+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:08.979 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:08 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:08.920+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:09.078 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:08 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:08.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:09.078 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:08 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:08.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:09.299 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:09 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:09.019+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:09.299 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:09 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:09.019+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:09.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:09 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:09.077+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:09.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:09 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:09.296+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:09.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:09 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:09.296+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:10.055 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:09 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:09.756+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:10.055 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:09 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:09.756+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:10.055 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:09 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:09.756+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:10.228 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:09 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:09.766+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:10.228 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:09 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:09.766+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.859860+0000 front 2026-02-13T01:30:43.859940+0000 (oldest deadline 2026-02-13T01:31:08.559891+0000) 2026-02-13T01:31:10.229 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:09 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:09.766+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:48.560079+0000 front 2026-02-13T01:30:48.560142+0000 (oldest deadline 2026-02-13T01:31:09.660159+0000) 2026-02-13T01:31:10.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:09 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:09.961+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:10.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:09 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:09.961+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:10.324 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:10 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:10.031+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:10.324 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:10 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:10.031+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:10.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:10 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:10.054+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:10.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:10 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:10.322+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:10.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:10 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:10.322+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:10.978 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:10 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:10.727+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.259201+0000 front 2026-02-13T01:30:36.259219+0000 (oldest deadline 2026-02-13T01:30:59.159317+0000) 2026-02-13T01:31:10.979 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:10 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:10.727+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.859860+0000 front 2026-02-13T01:30:43.859940+0000 (oldest deadline 2026-02-13T01:31:08.559891+0000) 2026-02-13T01:31:10.979 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:10 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6[51635]: 2026-02-13T01:31:10.727+0000 7f206f79b6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:48.560079+0000 front 2026-02-13T01:30:48.560142+0000 (oldest deadline 2026-02-13T01:31:09.660159+0000) 2026-02-13T01:31:10.979 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:10 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:10.968+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:10.979 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:10 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:10.968+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:11.042 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:10 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:10.746+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:11.043 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:10 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:10.746+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:11.043 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:10 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:10.746+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:11.298 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:11 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:11.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:11.298 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:11 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:11.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:11.298 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:11 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:11.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:11.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:11 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:11.042+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:11.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:11 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:11.296+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:11.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:11 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:11.296+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:12.056 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:12 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:12.001+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:12.056 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:12 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:12.001+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:12.057 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83121]: 2026-02-13 01:31:11.762003603 +0000 UTC m=+5.082105588 container died 30344ccd7048a62687dae8572c050586bcfb02b0551ebba132e3ed934ce4f2b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:31:12.057 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83121]: 2026-02-13 01:31:11.771772138 +0000 UTC m=+5.091874122 container remove 30344ccd7048a62687dae8572c050586bcfb02b0551ebba132e3ed934ce4f2b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 bash[83121]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83255]: 2026-02-13 01:31:11.902173979 +0000 UTC m=+0.016816872 container create b24bcd2c08a02bb339dd4fc35b5f8adfe27c5197a97cbc4dfcf9061f0f358355 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6-deactivate, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, version=10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83255]: 2026-02-13 01:31:11.932530141 +0000 UTC m=+0.047173034 container init b24bcd2c08a02bb339dd4fc35b5f8adfe27c5197a97cbc4dfcf9061f0f358355 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, name=rockylinux, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83255]: 2026-02-13 01:31:11.935000695 +0000 UTC m=+0.049643588 container start b24bcd2c08a02bb339dd4fc35b5f8adfe27c5197a97cbc4dfcf9061f0f358355 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, version=10, ceph=True, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7) 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83255]: 2026-02-13 01:31:11.935547018 +0000 UTC m=+0.050189901 container attach b24bcd2c08a02bb339dd4fc35b5f8adfe27c5197a97cbc4dfcf9061f0f358355 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6-deactivate, summary=Rocky Linux Base image, OSD_FLAVOR=default, version=10, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:11 trial091 podman[83255]: 2026-02-13 01:31:11.895482264 +0000 UTC m=+0.010125177 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:12.058 INFO:journalctl@ceph.osd.6.trial091.stdout:Feb 13 01:31:12 trial091 podman[83255]: 2026-02-13 01:31:12.056666899 +0000 UTC m=+0.171309792 container died b24bcd2c08a02bb339dd4fc35b5f8adfe27c5197a97cbc4dfcf9061f0f358355 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, ceph=True, license=BSD-3-Clause) 2026-02-13T01:31:12.068 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:11 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:11.786+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:12.068 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:11 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:11.786+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:12.069 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:11 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:11.786+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:12.092 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.6.service' 2026-02-13T01:31:12.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:12.131 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T01:31:12.131 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T01:31:12.131 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.7 2026-02-13T01:31:12.281 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:12 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:12.020+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:12.282 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:12 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:12.020+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:12.282 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:12 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:12.020+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:12.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:12.068+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:12.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:12.068+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.058517+0000 front 2026-02-13T01:30:47.058573+0000 (oldest deadline 2026-02-13T01:31:11.158560+0000) 2026-02-13T01:31:12.349 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:12 trial126 systemd[1]: Stopping Ceph osd.7 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:12.349 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:12.229+0000 7fdcbdb236c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:12.349 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:12.229+0000 7fdcbdb236c0 -1 osd.7 77 *** Got signal Terminated *** 2026-02-13T01:31:12.349 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:12.229+0000 7fdcbdb236c0 -1 osd.7 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:12.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:12 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:12.280+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:12.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:12 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:12.280+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:13.070 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:12.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:13.070 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:12.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:13.070 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:12 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:12.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:13.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:13 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:13.069+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:13.349 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:13 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:13.069+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.058517+0000 front 2026-02-13T01:30:47.058573+0000 (oldest deadline 2026-02-13T01:31:11.158560+0000) 2026-02-13T01:31:13.465 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:13 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:13.248+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:13.465 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:13 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:13.248+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:13.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:13 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:13.037+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:13.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:13 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:13.037+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:13.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:13 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:13.037+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:13.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:12 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:12.989+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:13.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:12 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:12.989+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:13.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:12 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:12.989+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:14.096 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:13 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:13.720+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:14.096 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:13 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:13.720+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:14.096 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:13 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:13.720+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:14.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:13 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:13.950+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:14.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:13 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:13.950+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:14.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:13 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:13.950+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:14.296 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:14.024+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:14.297 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:14.024+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:14.297 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:14.024+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:14.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:14 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:14.095+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:14.348 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:14 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:14.095+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.058517+0000 front 2026-02-13T01:30:47.058573+0000 (oldest deadline 2026-02-13T01:31:11.158560+0000) 2026-02-13T01:31:14.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:14.295+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:14.716 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:14.295+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:14.716 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:14.295+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:15.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:14 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:14.713+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:15.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:14 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:14.713+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:15.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:14 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:14.713+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:15.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:14 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:14.923+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:15.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:14 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:14.923+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:15.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:14 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:14.923+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:15.338 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:14.989+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:15.339 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:14.989+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:15.339 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:14 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:14.989+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:15.598 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:15 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:15.134+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:15.598 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:15 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:15.134+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.058517+0000 front 2026-02-13T01:30:47.058573+0000 (oldest deadline 2026-02-13T01:31:11.158560+0000) 2026-02-13T01:31:15.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:15.337+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:15.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:15.337+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:15.716 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:15.337+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:16.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:15 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:15.715+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:16.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:15 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:15.715+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:16.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:15 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:15.715+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:16.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:15 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:15.943+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:16.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:15 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:15.943+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:16.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:15 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:15.943+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:16.319 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:15.967+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:16.319 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:15.967+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:16.320 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:15.967+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:16.320 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:15 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:15.967+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:16.598 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:16 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:16.158+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:16.598 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:16 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:16.158+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.058517+0000 front 2026-02-13T01:30:47.058573+0000 (oldest deadline 2026-02-13T01:31:11.158560+0000) 2026-02-13T01:31:16.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:16.317+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:16.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:16.317+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:16.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:16.317+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:17.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:16 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:16.733+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:17.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:16 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:16.733+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:17.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:16 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:16.733+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:17.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:16 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:16.733+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:17.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:16 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:16.893+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:17.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:16 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:16.893+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:17.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:16 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:16.893+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:17.284 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:16.992+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:17.284 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:16.992+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:17.284 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:16.992+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:17.284 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:16 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:16.992+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:17.444 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:17 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:17.192+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:43.558280+0000 front 2026-02-13T01:30:43.558295+0000 (oldest deadline 2026-02-13T01:31:07.058366+0000) 2026-02-13T01:31:17.445 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:17 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7[45089]: 2026-02-13T01:31:17.192+0000 7fdcba1e86c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.058517+0000 front 2026-02-13T01:30:47.058573+0000 (oldest deadline 2026-02-13T01:31:11.158560+0000) 2026-02-13T01:31:17.445 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:17 trial126 podman[59598]: 2026-02-13 01:31:17.289467735 +0000 UTC m=+5.072503857 container died 034a29f167e4876d9df53f952f4cdbf6099deac21106dbd68277067fcb4ff818 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, io.buildah.version=1.33.7, summary=Rocky Linux Base image, version=10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T01:31:17.445 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:17 trial126 podman[59598]: 2026-02-13 01:31:17.297885473 +0000 UTC m=+5.080921605 container remove 034a29f167e4876d9df53f952f4cdbf6099deac21106dbd68277067fcb4ff818 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, ceph=True, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T01:31:17.445 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 13 01:31:17 trial126 bash[59598]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-7 2026-02-13T01:31:17.648 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.7.service' 2026-02-13T01:31:17.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:17.685 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T01:31:17.685 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T01:31:17.685 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.8 2026-02-13T01:31:17.706 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:17.282+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:17.706 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:17.282+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:17.707 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:17.282+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:17.965 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 systemd[1]: Stopping Ceph osd.8 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:17.966 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:17.785+0000 7f72915636c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:17.966 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:17.785+0000 7f72915636c0 -1 osd.8 77 *** Got signal Terminated *** 2026-02-13T01:31:17.966 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:17 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:17.785+0000 7f72915636c0 -1 osd.8 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:18.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:17 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:17.734+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:18.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:17 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:17.734+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:18.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:17 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:17.734+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:18.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:17 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:17.734+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:18.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:17 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:17.845+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:18.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:17 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:17.845+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:18.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:17 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:17.845+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:18.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:17 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:17.845+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:18.257 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:18.258 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:18.258 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:18.258 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.000+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:18.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:18.256+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:18.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:18.256+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:18.716 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:18 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:18.256+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:19.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:18 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:18.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:19.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:18 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:18.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:19.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:18 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:18.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:19.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:18 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:18.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:19.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:18 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:18.837+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:19.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:18 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:18.837+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:19.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:18 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:18.837+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:19.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:18 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:18.837+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:19.281 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.999+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:19.281 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.999+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:19.281 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.999+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:19.282 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:18.999+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:19.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:19.279+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:19.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:19.279+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:19.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:19 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:19.279+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:20.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:19 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:19.703+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:20.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:19 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:19.703+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:20.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:19 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:19.703+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:20.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:19 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:19.703+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:20.129 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:19 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:19.836+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:20.129 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:19 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:19.836+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:20.129 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:19 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:19.836+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:20.129 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:19 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:19.836+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:20.296 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:20.027+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:20.296 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:20.027+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:20.296 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:20.027+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:20.296 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:20.027+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:20.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:20.293+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:20.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:20.293+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:20.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:20 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:20.293+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:21.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:20 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:20.742+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:21.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:20 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:20.742+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:21.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:20 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:20.742+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:21.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:20 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:20.742+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:21.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:20.862+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:21.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:20.862+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:21.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:20.862+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:21.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:20 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:20.862+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:21.302 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:21.025+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:21.302 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:21.025+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:21.302 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:21.025+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:21.303 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:21.025+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:21.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:21.300+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:21.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:21.300+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:21.716 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:21 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:21.300+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:22.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:21 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:21.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:22.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:21 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:21.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:22.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:21 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:21.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:22.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:21 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:21.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:22.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:21 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:21.763+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:22.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:21.895+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:22.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:21.895+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:22.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:21.895+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:22.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:21.895+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:22.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:21 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:21.895+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:22.263 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:22.010+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:22.263 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:22.010+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:22.263 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:22.010+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:22.263 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:22.010+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:22.263 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:22.010+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:22.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:22.262+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:36.889310+0000 front 2026-02-13T01:30:36.889465+0000 (oldest deadline 2026-02-13T01:31:01.589270+0000) 2026-02-13T01:31:22.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:22.262+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:42.689726+0000 front 2026-02-13T01:30:42.689661+0000 (oldest deadline 2026-02-13T01:31:07.389716+0000) 2026-02-13T01:31:22.715 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:22 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8[45846]: 2026-02-13T01:31:22.262+0000 7f7289c206c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:47.389828+0000 front 2026-02-13T01:30:47.389841+0000 (oldest deadline 2026-02-13T01:31:13.289923+0000) 2026-02-13T01:31:23.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:22 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:22.791+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:23.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:22 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:22.791+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:23.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:22 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:22.791+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:23.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:22 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:22.791+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:23.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:22 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:22.791+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:23.159 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:23 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:23.034+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:23.160 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:23 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:23.034+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:23.160 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:23 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:23.034+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:23.160 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:23 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:23.034+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:23.160 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:23 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:23.034+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:23.160 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:22 trial154 podman[61333]: 2026-02-13 01:31:22.85636153 +0000 UTC m=+5.082411296 container died 045df6e4e6cdf9ff151e9b75be3c7b2fd134466bb906575df1594931b9f79875 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8, ceph=True, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:23.160 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:22 trial154 podman[61333]: 2026-02-13 01:31:22.865431861 +0000 UTC m=+5.091481627 container remove 045df6e4e6cdf9ff151e9b75be3c7b2fd134466bb906575df1594931b9f79875 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T01:31:23.161 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:22 trial154 bash[61333]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8 2026-02-13T01:31:23.161 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:23 trial154 podman[61466]: 2026-02-13 01:31:23.002367712 +0000 UTC m=+0.016855937 container create 2e8c37c7096dde805e1746e5337c8bc0b1c514b264ad2c3b46d7d5ca838151bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:23.161 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:23 trial154 podman[61466]: 2026-02-13 01:31:23.034918832 +0000 UTC m=+0.049407067 container init 2e8c37c7096dde805e1746e5337c8bc0b1c514b264ad2c3b46d7d5ca838151bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7) 2026-02-13T01:31:23.161 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:23 trial154 podman[61466]: 2026-02-13 01:31:23.03761531 +0000 UTC m=+0.052103535 container start 2e8c37c7096dde805e1746e5337c8bc0b1c514b264ad2c3b46d7d5ca838151bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, name=rockylinux, io.buildah.version=1.33.7, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:23.161 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:23 trial154 podman[61466]: 2026-02-13 01:31:23.038040276 +0000 UTC m=+0.052528501 container attach 2e8c37c7096dde805e1746e5337c8bc0b1c514b264ad2c3b46d7d5ca838151bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-8-deactivate, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:23.161 INFO:journalctl@ceph.osd.8.trial154.stdout:Feb 13 01:31:23 trial154 podman[61466]: 2026-02-13 01:31:22.995847335 +0000 UTC m=+0.010335570 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:23.192 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.8.service' 2026-02-13T01:31:23.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:22 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:22.933+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:23.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:22 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:22.933+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:23.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:22 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:22.933+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:23.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:22 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:22.933+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:23.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:22 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:22.933+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:23.268 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:23.269 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T01:31:23.269 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T01:31:23.269 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.9 2026-02-13T01:31:23.728 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 systemd[1]: Stopping Ceph osd.9 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:23.728 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.375+0000 7fac143376c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:23.728 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.375+0000 7fac143376c0 -1 osd.9 77 *** Got signal Terminated *** 2026-02-13T01:31:23.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.375+0000 7fac143376c0 -1 osd.9 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:24.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:23.752+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:24.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:23.752+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:24.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:23.752+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:24.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:23.752+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:24.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:23 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:23.752+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:24.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:24.049+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:24.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:24.049+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:24.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:24.049+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:24.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:24.049+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:24.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:24 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:24.049+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:24.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.980+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:24.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.980+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:24.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.980+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:24.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.980+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:24.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:23 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:23.980+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:25.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:24.794+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:25.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:24.794+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:25.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:24.794+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:25.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:24.794+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:25.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:24 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:24.794+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:25.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:24 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:24.962+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:25.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:24 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:24.962+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:25.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:24 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:24.962+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:25.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:24 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:24.962+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:25.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:24 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:24.962+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:25.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:25.065+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:25.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:25.065+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:25.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:25.065+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:25.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:25.065+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:25.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:25 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:25.065+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:26.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:25.769+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:26.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:25.769+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:26.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:25.769+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:26.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:25.769+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:26.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:25 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:25.769+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:26.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:25 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:25.942+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:26.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:25 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:25.942+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:26.228 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:25 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:25.942+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:26.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:25 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:25.942+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:26.229 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:25 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:25.942+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:26.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:26 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:26.115+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:26.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:26 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:26.115+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:26.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:26 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:26.115+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:26.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:26 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:26.115+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:26.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:26 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:26.115+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:27.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:26.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:27.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:26.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:27.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:26.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:27.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:26.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:27.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:26 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:26.725+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:27.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:27 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:27.164+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:27.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:27 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:27.164+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:27.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:27 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:27.164+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:27.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:27 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:27.164+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:27.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:27 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:27.164+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:27.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:27 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:27.164+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:27.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:26 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:26.982+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:27.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:26 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:26.982+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:27.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:26 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:26.982+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:27.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:26 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:26.982+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:27.478 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:26 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:26.982+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:28.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:27 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:27.696+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:28.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:27 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:27.696+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:28.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:27 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:27.696+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:28.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:27 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:27.696+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:28.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:27 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:27.696+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:28.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:27 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:27.696+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:28.435 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:27 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:27.988+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.895171+0000 front 2026-02-13T01:30:35.895182+0000 (oldest deadline 2026-02-13T01:31:01.795248+0000) 2026-02-13T01:31:28.435 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:27 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:27.988+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:41.795508+0000 front 2026-02-13T01:30:41.795497+0000 (oldest deadline 2026-02-13T01:31:06.495578+0000) 2026-02-13T01:31:28.435 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:27 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:27.988+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:46.495807+0000 front 2026-02-13T01:30:46.495860+0000 (oldest deadline 2026-02-13T01:31:12.395764+0000) 2026-02-13T01:31:28.436 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:27 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:27.988+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.696080+0000 front 2026-02-13T01:30:54.696069+0000 (oldest deadline 2026-02-13T01:31:17.596192+0000) 2026-02-13T01:31:28.436 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:27 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:27.988+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:57.596392+0000 front 2026-02-13T01:30:57.596443+0000 (oldest deadline 2026-02-13T01:31:21.696475+0000) 2026-02-13T01:31:28.436 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:27 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9[57954]: 2026-02-13T01:31:27.988+0000 7fac0c9f46c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.696780+0000 front 2026-02-13T01:31:01.696716+0000 (oldest deadline 2026-02-13T01:31:26.996649+0000) 2026-02-13T01:31:28.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:28 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:28.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:28.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:28 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:28.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:28.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:28 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:28.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:28.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:28 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:28.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:28.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:28 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:28.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:28.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:28 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:28.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:28.728 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83393]: 2026-02-13 01:31:28.436027436 +0000 UTC m=+5.072662780 container died 6fa1d7289b706785813e4272d8b0fc91b885e563f4101a6d28d9471d0e515a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.version=10, version=10, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:28.728 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83393]: 2026-02-13 01:31:28.444666114 +0000 UTC m=+5.081301468 container remove 6fa1d7289b706785813e4272d8b0fc91b885e563f4101a6d28d9471d0e515a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:28.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 bash[83393]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9 2026-02-13T01:31:28.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83520]: 2026-02-13 01:31:28.575834909 +0000 UTC m=+0.015841804 container create 3b5d53ec4bc62b59baa7694a997f843cc3e760d33c8ba681bd5f6f501c77382a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.33.7, name=rockylinux, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, version=10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux) 2026-02-13T01:31:28.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83520]: 2026-02-13 01:31:28.606590972 +0000 UTC m=+0.046597877 container init 3b5d53ec4bc62b59baa7694a997f843cc3e760d33c8ba681bd5f6f501c77382a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause) 2026-02-13T01:31:28.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83520]: 2026-02-13 01:31:28.608809929 +0000 UTC m=+0.048816824 container start 3b5d53ec4bc62b59baa7694a997f843cc3e760d33c8ba681bd5f6f501c77382a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9-deactivate, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:28.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83520]: 2026-02-13 01:31:28.609359599 +0000 UTC m=+0.049366504 container attach 3b5d53ec4bc62b59baa7694a997f843cc3e760d33c8ba681bd5f6f501c77382a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-9-deactivate, version=10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:28.729 INFO:journalctl@ceph.osd.9.trial091.stdout:Feb 13 01:31:28 trial091 podman[83520]: 2026-02-13 01:31:28.569769225 +0000 UTC m=+0.009776130 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:28.770 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.9.service' 2026-02-13T01:31:28.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:28.808 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T01:31:28.808 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T01:31:28.808 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.10 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.680+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.680+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.680+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.680+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.680+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.680+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:29.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 systemd[1]: Stopping Ceph osd.10 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:29.100 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.909+0000 7f2620f3f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:29.100 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.909+0000 7f2620f3f6c0 -1 osd.10 77 *** Got signal Terminated *** 2026-02-13T01:31:29.100 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:28 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:28.909+0000 7f2620f3f6c0 -1 osd.10 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:29.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:29 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:29.204+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:29.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:29 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:29.204+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:29.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:29 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:29.204+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:29.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:29 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:29.204+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:29.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:29 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:29.204+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:29.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:29 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:29.204+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:30.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:29 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:29.686+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:30.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:29 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:29.686+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:30.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:29 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:29.686+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:30.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:29 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:29.686+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:30.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:29 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:29.686+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:30.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:29 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:29.686+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:30.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:30 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:30.154+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:30.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:30 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:30.154+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:30.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:30 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:30.154+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:30.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:30 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:30.154+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:30.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:30 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:30.154+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:30.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:30 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:30.154+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:30.999 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:30 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:30.718+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:30.999 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:30 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:30.718+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:31.000 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:30 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:30.718+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:31.000 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:30 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:30.718+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:31.000 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:30 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:30.718+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:31.000 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:30 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:30.718+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:31.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:31 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:31.141+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:31.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:31 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:31.141+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:31.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:31 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:31.141+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:31.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:31 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:31.141+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:31.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:31 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:31.141+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:31.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:31 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:31.141+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:32.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:31 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:31.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:32.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:31 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:31.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:32.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:31 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:31.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:32.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:31 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:31.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:32.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:31 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:31.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:32.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:31 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:31.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:32.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:32.183+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:32.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:32.183+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:32.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:32.183+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:32.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:32.183+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:32.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:32.183+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:32.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:32 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:32.183+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:33.098 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:33.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:33.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:33.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:33.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:33.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:33.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:32 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:32.771+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6822 osd.6 since back 2026-02-13T01:31:09.572213+0000 front 2026-02-13T01:31:09.572273+0000 (oldest deadline 2026-02-13T01:31:31.872090+0000) 2026-02-13T01:31:33.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:33 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:33.173+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:33.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:33 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:33.173+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:33.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:33 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:33.173+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:33.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:33 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:33.173+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:33.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:33 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:33.173+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:33.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:33 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:33.173+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:33.979 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:34.069412+0000 front 2026-02-13T01:30:34.069575+0000 (oldest deadline 2026-02-13T01:30:58.769494+0000) 2026-02-13T01:31:33.980 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:39.869860+0000 front 2026-02-13T01:30:39.869873+0000 (oldest deadline 2026-02-13T01:31:06.870181+0000) 2026-02-13T01:31:33.980 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:49.170730+0000 front 2026-02-13T01:30:49.170743+0000 (oldest deadline 2026-02-13T01:31:09.670776+0000) 2026-02-13T01:31:33.980 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:53.171202+0000 front 2026-02-13T01:30:53.171231+0000 (oldest deadline 2026-02-13T01:31:16.071247+0000) 2026-02-13T01:31:33.980 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:56.071403+0000 front 2026-02-13T01:30:56.071417+0000 (oldest deadline 2026-02-13T01:31:21.371511+0000) 2026-02-13T01:31:33.980 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.371766+0000 front 2026-02-13T01:31:01.371829+0000 (oldest deadline 2026-02-13T01:31:27.271699+0000) 2026-02-13T01:31:33.980 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10[51598]: 2026-02-13T01:31:33.723+0000 7f26195fc6c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.91:6822 osd.6 since back 2026-02-13T01:31:09.572213+0000 front 2026-02-13T01:31:09.572273+0000 (oldest deadline 2026-02-13T01:31:31.872090+0000) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 podman[59858]: 2026-02-13 01:31:33.979081069 +0000 UTC m=+5.081432462 container died 917354a9b71e42256f2db03dd1abb72033c458079160e0cc5ed46e88b55185fe (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, ceph=True) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 podman[59858]: 2026-02-13 01:31:33.987263621 +0000 UTC m=+5.089615004 container remove 917354a9b71e42256f2db03dd1abb72033c458079160e0cc5ed46e88b55185fe (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:33 trial126 bash[59858]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:34 trial126 podman[59996]: 2026-02-13 01:31:34.113991594 +0000 UTC m=+0.015800488 container create d7d225c16aa2ce5472ff8b5c55f442274aef422e30811bd4d1456aebf5847029 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:34 trial126 podman[59996]: 2026-02-13 01:31:34.147265579 +0000 UTC m=+0.049074473 container init d7d225c16aa2ce5472ff8b5c55f442274aef422e30811bd4d1456aebf5847029 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10-deactivate, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, version=10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:34 trial126 podman[59996]: 2026-02-13 01:31:34.149842417 +0000 UTC m=+0.051651311 container start d7d225c16aa2ce5472ff8b5c55f442274aef422e30811bd4d1456aebf5847029 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, version=10, ceph=True, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:34 trial126 podman[59996]: 2026-02-13 01:31:34.15057253 +0000 UTC m=+0.052381434 container attach d7d225c16aa2ce5472ff8b5c55f442274aef422e30811bd4d1456aebf5847029 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7) 2026-02-13T01:31:34.279 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:34 trial126 podman[59996]: 2026-02-13 01:31:34.1079437 +0000 UTC m=+0.009752584 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:34.280 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 13 01:31:34 trial126 podman[59996]: 2026-02-13 01:31:34.278303343 +0000 UTC m=+0.180112227 container died d7d225c16aa2ce5472ff8b5c55f442274aef422e30811bd4d1456aebf5847029 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.title=rockylinux, name=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T01:31:34.311 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.10.service' 2026-02-13T01:31:34.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:34.349 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T01:31:34.349 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T01:31:34.350 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.11 2026-02-13T01:31:34.450 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.162+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.162+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.162+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.162+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.162+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.162+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 systemd[1]: Stopping Ceph osd.11 for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.447+0000 7feeb9dd76c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T01:31:34.451 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.447+0000 7feeb9dd76c0 -1 osd.11 77 *** Got signal Terminated *** 2026-02-13T01:31:34.452 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:34 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:34.447+0000 7feeb9dd76c0 -1 osd.11 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T01:31:35.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:35 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:35.198+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:35.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:35 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:35.198+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:35.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:35 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:35.198+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:35.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:35 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:35.198+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:35.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:35 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:35.198+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:35.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:35 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:35.198+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:36.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:36 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:36.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:36.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:36 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:36.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:36.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:36 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:36.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:36.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:36 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:36.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:36.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:36 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:36.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:36.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:36 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:36.166+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:37.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:37 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:37.133+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:37.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:37 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:37.133+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:37.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:37 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:37.133+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:37.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:37 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:37.133+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:37.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:37 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:37.133+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:37.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:37 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:37.133+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:38.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.152+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:38.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.152+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:38.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.153+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:38.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.153+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:38.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.153+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:38.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.153+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:38.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:38 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:38.153+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6820 osd.7 since back 2026-02-13T01:31:12.356093+0000 front 2026-02-13T01:31:12.356081+0000 (oldest deadline 2026-02-13T01:31:37.656017+0000) 2026-02-13T01:31:39.465 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6806 osd.0 since back 2026-02-13T01:30:35.454003+0000 front 2026-02-13T01:30:35.454065+0000 (oldest deadline 2026-02-13T01:30:58.954086+0000) 2026-02-13T01:31:39.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-13T01:30:38.954357+0000 front 2026-02-13T01:30:38.954346+0000 (oldest deadline 2026-02-13T01:31:04.254312+0000) 2026-02-13T01:31:39.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6804 osd.2 since back 2026-02-13T01:30:44.254462+0000 front 2026-02-13T01:30:44.254476+0000 (oldest deadline 2026-02-13T01:31:10.154569+0000) 2026-02-13T01:31:39.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.91:6814 osd.3 since back 2026-02-13T01:30:54.855000+0000 front 2026-02-13T01:30:54.855010+0000 (oldest deadline 2026-02-13T01:31:15.355051+0000) 2026-02-13T01:31:39.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-13T01:30:55.355352+0000 front 2026-02-13T01:30:55.355314+0000 (oldest deadline 2026-02-13T01:31:21.255270+0000) 2026-02-13T01:31:39.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.154:6812 osd.5 since back 2026-02-13T01:31:01.255582+0000 front 2026-02-13T01:31:01.255535+0000 (oldest deadline 2026-02-13T01:31:27.155465+0000) 2026-02-13T01:31:39.466 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11[52061]: 2026-02-13T01:31:39.131+0000 7feeb649c6c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.126:6820 osd.7 since back 2026-02-13T01:31:12.356093+0000 front 2026-02-13T01:31:12.356081+0000 (oldest deadline 2026-02-13T01:31:37.656017+0000) 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61600]: 2026-02-13 01:31:39.518558324 +0000 UTC m=+5.083253274 container died e03df21feec6e4b5f18d6316bc40c200b18887a6ec6d79a5544376df3fe9e2c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux) 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61600]: 2026-02-13 01:31:39.526934474 +0000 UTC m=+5.091629414 container remove e03df21feec6e4b5f18d6316bc40c200b18887a6ec6d79a5544376df3fe9e2c6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 bash[61600]: ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61731]: 2026-02-13 01:31:39.648982842 +0000 UTC m=+0.015198722 container create 140d672ad4459459421e74e863d6275d1a7f40a9fe3508c442c4207dc2862de7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, io.buildah.version=1.33.7, ceph=True) 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61731]: 2026-02-13 01:31:39.679834294 +0000 UTC m=+0.046050174 container init 140d672ad4459459421e74e863d6275d1a7f40a9fe3508c442c4207dc2862de7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, ceph=True, version=10, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61731]: 2026-02-13 01:31:39.682573923 +0000 UTC m=+0.048789793 container start 140d672ad4459459421e74e863d6275d1a7f40a9fe3508c442c4207dc2862de7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, summary=Rocky Linux Base image, org.opencontainers.image.version=10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, license=BSD-3-Clause) 2026-02-13T01:31:39.809 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61731]: 2026-02-13 01:31:39.683019206 +0000 UTC m=+0.049235096 container attach 140d672ad4459459421e74e863d6275d1a7f40a9fe3508c442c4207dc2862de7 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-7155d718-087a-11f1-982a-d404e6e7d460-osd-11-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, org.opencontainers.image.version=10, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T01:31:39.810 INFO:journalctl@ceph.osd.11.trial154.stdout:Feb 13 01:31:39 trial154 podman[61731]: 2026-02-13 01:31:39.643369084 +0000 UTC m=+0.009584954 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T01:31:39.835 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@osd.11.service' 2026-02-13T01:31:39.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:39.871 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T01:31:39.872 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T01:31:39.872 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.a 2026-02-13T01:31:40.228 INFO:journalctl@ceph.mds.a.trial091.stdout:Feb 13 01:31:39 trial091 systemd[1]: Stopping Ceph mds.a for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:40.228 INFO:journalctl@ceph.mds.a.trial091.stdout:Feb 13 01:31:39 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-a[63750]: 2026-02-13T01:31:39.967+0000 7f6a5c36e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:40.229 INFO:journalctl@ceph.mds.a.trial091.stdout:Feb 13 01:31:39 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-a[63750]: 2026-02-13T01:31:39.967+0000 7f6a5c36e6c0 -1 mds.a *** got signal Terminated *** 2026-02-13T01:31:41.007 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.a.service' 2026-02-13T01:31:41.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:41.041 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T01:31:41.041 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T01:31:41.042 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.d 2026-02-13T01:31:41.228 INFO:journalctl@ceph.mds.d.trial091.stdout:Feb 13 01:31:41 trial091 systemd[1]: Stopping Ceph mds.d for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:41.228 INFO:journalctl@ceph.mds.d.trial091.stdout:Feb 13 01:31:41 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-d[62889]: 2026-02-13T01:31:41.177+0000 7ff4307ea6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:41.228 INFO:journalctl@ceph.mds.d.trial091.stdout:Feb 13 01:31:41 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-d[62889]: 2026-02-13T01:31:41.177+0000 7ff4307ea6c0 -1 mds.d *** got signal Terminated *** 2026-02-13T01:31:42.212 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.d.service' 2026-02-13T01:31:42.246 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:42.247 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T01:31:42.247 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T01:31:42.247 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.g 2026-02-13T01:31:42.478 INFO:journalctl@ceph.mds.g.trial091.stdout:Feb 13 01:31:42 trial091 systemd[1]: Stopping Ceph mds.g for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:42.478 INFO:journalctl@ceph.mds.g.trial091.stdout:Feb 13 01:31:42 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-g[63425]: 2026-02-13T01:31:42.382+0000 7f04a363d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:42.479 INFO:journalctl@ceph.mds.g.trial091.stdout:Feb 13 01:31:42 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-g[63425]: 2026-02-13T01:31:42.382+0000 7f04a363d6c0 -1 mds.g *** got signal Terminated *** 2026-02-13T01:31:43.586 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.g.service' 2026-02-13T01:31:43.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:43.618 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T01:31:43.618 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T01:31:43.619 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.j 2026-02-13T01:31:43.978 INFO:journalctl@ceph.mds.j.trial091.stdout:Feb 13 01:31:43 trial091 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-j[62519]: 2026-02-13T01:31:43.744+0000 7f7c061606c0 -1 mds.j *** got signal Terminated *** 2026-02-13T01:31:44.783 DEBUG:teuthology.orchestra.run.trial091:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.j.service' 2026-02-13T01:31:44.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:44.816 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T01:31:44.817 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T01:31:44.817 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.b 2026-02-13T01:31:45.098 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:31:44 trial126 systemd[1]: Stopping Ceph mds.b for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:45.099 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:31:44 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: 2026-02-13T01:31:44.921+0000 7f167a2a56c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:45.099 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 13 01:31:44 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-b[56397]: 2026-02-13T01:31:44.921+0000 7f167a2a56c0 -1 mds.b *** got signal Terminated *** 2026-02-13T01:31:49.855 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.b.service' 2026-02-13T01:31:49.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:49.889 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T01:31:49.889 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T01:31:49.889 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.e 2026-02-13T01:31:50.099 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 13 01:31:49 trial126 systemd[1]: Stopping Ceph mds.e for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:50.099 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 13 01:31:50 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-e[55750]: 2026-02-13T01:31:50.022+0000 7f35c771f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:50.099 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 13 01:31:50 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-e[55750]: 2026-02-13T01:31:50.022+0000 7f35c771f6c0 -1 mds.e *** got signal Terminated *** 2026-02-13T01:31:52.854 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.e.service' 2026-02-13T01:31:52.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:52.887 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T01:31:52.887 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T01:31:52.887 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.h 2026-02-13T01:31:53.098 INFO:journalctl@ceph.mds.h.trial126.stdout:Feb 13 01:31:52 trial126 systemd[1]: Stopping Ceph mds.h for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:53.098 INFO:journalctl@ceph.mds.h.trial126.stdout:Feb 13 01:31:53 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-h[56074]: 2026-02-13T01:31:53.022+0000 7fb6a5a076c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:53.098 INFO:journalctl@ceph.mds.h.trial126.stdout:Feb 13 01:31:53 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-h[56074]: 2026-02-13T01:31:53.022+0000 7fb6a5a076c0 -1 mds.h *** got signal Terminated *** 2026-02-13T01:31:55.953 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.h.service' 2026-02-13T01:31:55.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:55.986 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T01:31:55.986 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T01:31:55.986 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.k 2026-02-13T01:31:56.348 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 13 01:31:56 trial126 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-k[55428]: 2026-02-13T01:31:56.122+0000 7f0cc7c036c0 -1 mds.k *** got signal Terminated *** 2026-02-13T01:31:57.173 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.k.service' 2026-02-13T01:31:57.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:57.206 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T01:31:57.206 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T01:31:57.207 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.c 2026-02-13T01:31:57.715 INFO:journalctl@ceph.mds.c.trial154.stdout:Feb 13 01:31:57 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-c[56625]: 2026-02-13T01:31:57.301+0000 7f9cd8f926c0 -1 mds.c *** got signal Terminated *** 2026-02-13T01:31:58.457 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.c.service' 2026-02-13T01:31:58.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:58.491 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T01:31:58.491 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T01:31:58.491 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.f 2026-02-13T01:31:58.627 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 01:31:58 trial154 systemd[1]: Stopping Ceph mds.f for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:31:58.627 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 01:31:58 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-f[56300]: 2026-02-13T01:31:58.623+0000 7fab00e576c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:31:58.627 INFO:journalctl@ceph.mds.f.trial154.stdout:Feb 13 01:31:58 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-f[56300]: 2026-02-13T01:31:58.623+0000 7fab00e576c0 -1 mds.f *** got signal Terminated *** 2026-02-13T01:31:59.810 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.f.service' 2026-02-13T01:31:59.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:31:59.843 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T01:31:59.843 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T01:31:59.843 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.i 2026-02-13T01:32:00.215 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:31:59 trial154 systemd[1]: Stopping Ceph mds.i for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:32:00.216 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:31:59 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-i[56945]: 2026-02-13T01:31:59.968+0000 7fe91fcf16c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:00.216 INFO:journalctl@ceph.mds.i.trial154.stdout:Feb 13 01:31:59 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-i[56945]: 2026-02-13T01:31:59.968+0000 7fe91fcf16c0 -1 mds.i *** got signal Terminated *** 2026-02-13T01:32:01.020 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.i.service' 2026-02-13T01:32:01.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:01.052 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T01:32:01.052 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T01:32:01.052 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.l 2026-02-13T01:32:01.215 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 01:32:01 trial154 systemd[1]: Stopping Ceph mds.l for 7155d718-087a-11f1-982a-d404e6e7d460... 2026-02-13T01:32:01.215 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 01:32:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-l[55976]: 2026-02-13T01:32:01.186+0000 7ff5eed1b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T01:32:01.215 INFO:journalctl@ceph.mds.l.trial154.stdout:Feb 13 01:32:01 trial154 ceph-7155d718-087a-11f1-982a-d404e6e7d460-mds-l[55976]: 2026-02-13T01:32:01.186+0000 7ff5eed1b6c0 -1 mds.l *** got signal Terminated *** 2026-02-13T01:32:02.796 DEBUG:teuthology.orchestra.run.trial154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7155d718-087a-11f1-982a-d404e6e7d460@mds.l.service' 2026-02-13T01:32:02.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T01:32:02.829 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T01:32:02.829 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --force --keep-logs 2026-02-13T01:32:02.950 INFO:teuthology.orchestra.run.trial091.stdout:Deleting cluster with fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:32:04.766 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --force --keep-logs 2026-02-13T01:32:04.890 INFO:teuthology.orchestra.run.trial126.stdout:Deleting cluster with fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:32:06.677 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --force --keep-logs 2026-02-13T01:32:06.794 INFO:teuthology.orchestra.run.trial154.stdout:Deleting cluster with fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:32:08.545 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:32:08.574 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:32:08.602 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T01:32:08.629 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T01:32:08.632 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial091/crash 2026-02-13T01:32:08.633 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash -- . 2026-02-13T01:32:08.660 INFO:teuthology.orchestra.run.trial091.stderr:tar: /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:32:08.660 INFO:teuthology.orchestra.run.trial091.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:32:08.663 DEBUG:teuthology.misc:Transferring archived files from trial126:/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial126/crash 2026-02-13T01:32:08.664 DEBUG:teuthology.orchestra.run.trial126:> sudo tar c -f - -C /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash -- . 2026-02-13T01:32:08.689 INFO:teuthology.orchestra.run.trial126.stderr:tar: /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:32:08.689 INFO:teuthology.orchestra.run.trial126.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:32:08.691 DEBUG:teuthology.misc:Transferring archived files from trial154:/var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial154/crash 2026-02-13T01:32:08.692 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash -- . 2026-02-13T01:32:08.717 INFO:teuthology.orchestra.run.trial154.stderr:tar: /var/lib/ceph/7155d718-087a-11f1-982a-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T01:32:08.717 INFO:teuthology.orchestra.run.trial154.stderr:tar: Error is not recoverable: exiting now 2026-02-13T01:32:08.718 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T01:32:08.719 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T01:32:08.745 INFO:teuthology.orchestra.run.trial091.stdout:2026-02-13T01:23:37.692740+0000 mon.a (mon.0) 415 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:32:08.745 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T01:32:08.746 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -E '\[SEC\]' /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T01:32:08.811 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -E '\[ERR\]' /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T01:32:08.877 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -E '\[WRN\]' /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T01:32:08.943 INFO:teuthology.orchestra.run.trial091.stdout:2026-02-13T01:23:37.692740+0000 mon.a (mon.0) 415 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T01:32:08.944 INFO:tasks.cephadm:Compressing logs... 2026-02-13T01:32:08.944 DEBUG:teuthology.orchestra.run.trial091:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:08.987 DEBUG:teuthology.orchestra.run.trial126:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:08.990 DEBUG:teuthology.orchestra.run.trial154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:09.008 INFO:teuthology.orchestra.run.trial091.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:32:09.008 INFO:teuthology.orchestra.run.trial091.stderr:: No such file or directory 2026-02-13T01:32:09.012 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.a.log 2026-02-13T01:32:09.012 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.d.log 2026-02-13T01:32:09.012 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.j.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.0.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.d.log: /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.3.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.a.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.g.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr: 60.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr: 95.0% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:32:09.013 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.6.log 2026-02-13T01:32:09.014 INFO:teuthology.orchestra.run.trial091.stderr: 95.0% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T01:32:09.014 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.x.log 2026-02-13T01:32:09.014 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log 2026-02-13T01:32:09.014 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.9.log 2026-02-13T01:32:09.015 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log: /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.9.log: 91.0% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:32:09.015 INFO:teuthology.orchestra.run.trial091.stderr: 86.6% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log.gz 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.y.log 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.b.log 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.h.log 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.7.log 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:32:09.019 INFO:teuthology.orchestra.run.trial126.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.10.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.4.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log: 35.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.b.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.1.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log: 92.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.k.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.e.log 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.e.log: 86.6% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log.gz 2026-02-13T01:32:09.020 INFO:teuthology.orchestra.run.trial126.stderr: 91.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:32:09.021 INFO:teuthology.orchestra.run.trial126.stderr: 93.3% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:32:09.022 INFO:teuthology.orchestra.run.trial091.stderr: 93.3% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:32:09.022 INFO:teuthology.orchestra.run.trial091.stderr: 95.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.2.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose/var/log/ceph/cephadm.log: -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.i.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.c.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.f.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.5.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log 2026-02-13T01:32:09.026 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.11.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr: 35.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.z.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log: /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.l.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.c.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.8.log 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log: 91.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.audit.log.gz 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.8.log: 86.6% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph.log.gz 2026-02-13T01:32:09.027 INFO:teuthology.orchestra.run.trial154.stderr: 92.4% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T01:32:09.028 INFO:teuthology.orchestra.run.trial154.stderr: 93.8% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-volume.log.gz 2026-02-13T01:32:09.029 INFO:teuthology.orchestra.run.trial091.stderr: 94.8% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T01:32:09.029 INFO:teuthology.orchestra.run.trial154.stderr: 94.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T01:32:09.029 INFO:teuthology.orchestra.run.trial154.stderr: 94.3% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T01:32:09.029 INFO:teuthology.orchestra.run.trial126.stderr: 94.0% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T01:32:09.029 INFO:teuthology.orchestra.run.trial126.stderr: 94.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T01:32:09.029 INFO:teuthology.orchestra.run.trial126.stderr: 95.0% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T01:32:09.030 INFO:teuthology.orchestra.run.trial154.stderr: 94.8% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T01:32:09.030 INFO:teuthology.orchestra.run.trial154.stderr: 94.5% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T01:32:09.049 INFO:teuthology.orchestra.run.trial126.stderr: 93.3% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T01:32:09.108 INFO:teuthology.orchestra.run.trial126.stderr: 92.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T01:32:09.109 INFO:teuthology.orchestra.run.trial091.stderr: 90.0% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T01:32:09.111 INFO:teuthology.orchestra.run.trial154.stderr: 92.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T01:32:09.150 INFO:teuthology.orchestra.run.trial154.stderr: 92.8% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T01:32:09.177 INFO:teuthology.orchestra.run.trial091.stderr: 92.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T01:32:09.178 INFO:teuthology.orchestra.run.trial091.stderr: 91.9% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T01:32:09.180 INFO:teuthology.orchestra.run.trial126.stderr: 92.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T01:32:09.180 INFO:teuthology.orchestra.run.trial091.stderr: 92.3% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T01:32:09.187 INFO:teuthology.orchestra.run.trial091.stderr: 92.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T01:32:09.194 INFO:teuthology.orchestra.run.trial154.stderr: 92.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T01:32:09.200 INFO:teuthology.orchestra.run.trial126.stderr: 92.3% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T01:32:09.224 INFO:teuthology.orchestra.run.trial126.stderr: 92.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T01:32:09.224 INFO:teuthology.orchestra.run.trial154.stderr: 92.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T01:32:09.238 INFO:teuthology.orchestra.run.trial154.stderr: 92.1% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T01:32:09.239 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-13T01:32:09.239 INFO:teuthology.orchestra.run.trial154.stderr:real 0m0.233s 2026-02-13T01:32:09.240 INFO:teuthology.orchestra.run.trial154.stderr:user 0m0.855s 2026-02-13T01:32:09.240 INFO:teuthology.orchestra.run.trial154.stderr:sys 0m0.059s 2026-02-13T01:32:09.247 INFO:teuthology.orchestra.run.trial126.stderr: 92.4% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T01:32:09.248 INFO:teuthology.orchestra.run.trial126.stderr: 2026-02-13T01:32:09.248 INFO:teuthology.orchestra.run.trial126.stderr:real 0m0.244s 2026-02-13T01:32:09.248 INFO:teuthology.orchestra.run.trial126.stderr:user 0m0.919s 2026-02-13T01:32:09.248 INFO:teuthology.orchestra.run.trial126.stderr:sys 0m0.072s 2026-02-13T01:32:09.312 INFO:teuthology.orchestra.run.trial091.stderr: 90.2% -- replaced with /var/log/ceph/7155d718-087a-11f1-982a-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T01:32:09.314 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-13T01:32:09.314 INFO:teuthology.orchestra.run.trial091.stderr:real 0m0.313s 2026-02-13T01:32:09.314 INFO:teuthology.orchestra.run.trial091.stderr:user 0m1.048s 2026-02-13T01:32:09.314 INFO:teuthology.orchestra.run.trial091.stderr:sys 0m0.090s 2026-02-13T01:32:09.315 INFO:tasks.cephadm:Archiving logs... 2026-02-13T01:32:09.315 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial091/log 2026-02-13T01:32:09.317 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:32:09.550 DEBUG:teuthology.misc:Transferring archived files from trial126:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial126/log 2026-02-13T01:32:09.551 DEBUG:teuthology.orchestra.run.trial126:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:32:09.668 DEBUG:teuthology.misc:Transferring archived files from trial154:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial154/log 2026-02-13T01:32:09.668 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T01:32:09.780 INFO:tasks.cephadm:Removing cluster... 2026-02-13T01:32:09.780 DEBUG:teuthology.orchestra.run.trial091:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --force 2026-02-13T01:32:09.898 INFO:teuthology.orchestra.run.trial091.stdout:Deleting cluster with fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:32:10.065 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --force 2026-02-13T01:32:10.186 INFO:teuthology.orchestra.run.trial126.stdout:Deleting cluster with fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:32:10.353 DEBUG:teuthology.orchestra.run.trial154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7155d718-087a-11f1-982a-d404e6e7d460 --force 2026-02-13T01:32:10.476 INFO:teuthology.orchestra.run.trial154.stdout:Deleting cluster with fsid: 7155d718-087a-11f1-982a-d404e6e7d460 2026-02-13T01:32:10.637 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T01:32:10.637 DEBUG:teuthology.orchestra.run.trial091:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:32:10.655 DEBUG:teuthology.orchestra.run.trial126:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:32:10.674 DEBUG:teuthology.orchestra.run.trial154:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T01:32:10.690 INFO:tasks.cephadm:Teardown complete 2026-02-13T01:32:10.691 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_2a169eb9e607483c93b70d215a0ade702b8a648f/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T01:32:10.693 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T01:32:10.708 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T01:32:10.721 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T01:32:10.722 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:32:10.725 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:32:10.727 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T01:32:10.967 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T01:32:10.978 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T01:32:10.978 DEBUG:teuthology.orchestra.run.trial091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:32:10.980 DEBUG:teuthology.orchestra.run.trial126:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:32:10.982 DEBUG:teuthology.orchestra.run.trial154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T01:32:10.993 INFO:teuthology.orchestra.run.trial091.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:32:10.996 INFO:teuthology.orchestra.run.trial126.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:32:10.998 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: ntpq: command not found 2026-02-13T01:32:11.027 INFO:teuthology.orchestra.run.trial126.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:32:11.028 INFO:teuthology.orchestra.run.trial126.stdout:=============================================================================== 2026-02-13T01:32:11.028 INFO:teuthology.orchestra.run.trial126.stdout:^- 23.186.168.133 2 6 377 32 -6818us[-6818us] +/- 61ms 2026-02-13T01:32:11.028 INFO:teuthology.orchestra.run.trial126.stdout:^* time.cloudflare.com 3 6 377 34 +513us[ +529us] +/- 6451us 2026-02-13T01:32:11.028 INFO:teuthology.orchestra.run.trial126.stdout:^+ 107-172-222-7-host.coloc> 2 6 377 34 +231us[ +231us] +/- 14ms 2026-02-13T01:32:11.028 INFO:teuthology.orchestra.run.trial126.stdout:^+ 99-28-14-242.lightspeed.> 1 6 377 36 -1346us[-1329us] +/- 14ms 2026-02-13T01:32:11.032 INFO:teuthology.orchestra.run.trial154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:32:11.032 INFO:teuthology.orchestra.run.trial154.stdout:=============================================================================== 2026-02-13T01:32:11.032 INFO:teuthology.orchestra.run.trial154.stdout:^* 149.28.61.105.vultruserc> 3 6 377 34 +968us[ +997us] +/- 5724us 2026-02-13T01:32:11.032 INFO:teuthology.orchestra.run.trial154.stdout:^- 108.61.73.243 2 6 377 35 -35us[-6209ns] +/- 19ms 2026-02-13T01:32:11.032 INFO:teuthology.orchestra.run.trial154.stdout:^- ntp1.glypnod.com 2 6 377 34 +431us[ +460us] +/- 41ms 2026-02-13T01:32:11.032 INFO:teuthology.orchestra.run.trial154.stdout:^- jane.mattnordhoffdns.net 2 6 177 35 -998us[ -969us] +/- 53ms 2026-02-13T01:32:11.045 INFO:teuthology.orchestra.run.trial091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T01:32:11.045 INFO:teuthology.orchestra.run.trial091.stdout:=============================================================================== 2026-02-13T01:32:11.045 INFO:teuthology.orchestra.run.trial091.stdout:^+ europa.ellipse.net 2 6 377 32 +1343us[+1343us] +/- 60ms 2026-02-13T01:32:11.045 INFO:teuthology.orchestra.run.trial091.stdout:^+ 149.28.200.179.vultruser> 2 6 377 33 +595us[ +595us] +/- 40ms 2026-02-13T01:32:11.045 INFO:teuthology.orchestra.run.trial091.stdout:^* ntp.nexcess.net 3 6 377 35 +1801us[+1895us] +/- 49ms 2026-02-13T01:32:11.045 INFO:teuthology.orchestra.run.trial091.stdout:^+ 172-104-28-175.ip.linode> 2 6 377 35 -4359us[-4266us] +/- 59ms 2026-02-13T01:32:11.046 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T01:32:11.057 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T01:32:11.057 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T01:32:11.071 DEBUG:teuthology.orchestra.run.trial091:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:32:11.138 DEBUG:teuthology.orchestra.run.trial126:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:32:11.183 DEBUG:teuthology.orchestra.run.trial154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T01:32:11.229 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:32:11.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:11.257 DEBUG:teuthology.orchestra.run.trial126:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:32:11.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:11.285 DEBUG:teuthology.orchestra.run.trial154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T01:32:11.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:11.313 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T01:32:11.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T01:32:11.344 INFO:teuthology.task.internal:Duration was 778.590517 seconds 2026-02-13T01:32:11.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T01:32:11.362 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T01:32:11.362 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:32:11.365 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:32:11.368 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T01:32:11.401 INFO:teuthology.orchestra.run.trial091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:32:11.403 INFO:teuthology.orchestra.run.trial126.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:32:11.404 INFO:teuthology.orchestra.run.trial154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T01:32:11.765 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T01:32:11.766 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial091.front.sepia.ceph.com 2026-02-13T01:32:11.766 DEBUG:teuthology.orchestra.run.trial091:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:32:11.824 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial126.front.sepia.ceph.com 2026-02-13T01:32:11.825 DEBUG:teuthology.orchestra.run.trial126:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:32:11.845 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial154.front.sepia.ceph.com 2026-02-13T01:32:11.846 DEBUG:teuthology.orchestra.run.trial154:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T01:32:11.866 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T01:32:11.866 DEBUG:teuthology.orchestra.run.trial091:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:11.869 DEBUG:teuthology.orchestra.run.trial126:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:11.888 DEBUG:teuthology.orchestra.run.trial154:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:12.121 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T01:32:12.122 DEBUG:teuthology.orchestra.run.trial091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:12.124 DEBUG:teuthology.orchestra.run.trial126:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:12.127 DEBUG:teuthology.orchestra.run.trial154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T01:32:12.145 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:32:12.147 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:32:12.147 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:32:12.147 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:12.147 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:32:12.149 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:32:12.150 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:32:12.151 INFO:teuthology.orchestra.run.trial126.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:32:12.151 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:12.151 INFO:teuthology.orchestra.run.trial126.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:32:12.152 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T01:32:12.153 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T01:32:12.153 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T01:32:12.153 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T01:32:12.153 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T01:32:12.163 INFO:teuthology.orchestra.run.trial126.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:32:12.167 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:32:12.193 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T01:32:12.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T01:32:12.212 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T01:32:12.213 DEBUG:teuthology.orchestra.run.trial091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:32:12.262 DEBUG:teuthology.orchestra.run.trial126:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:32:12.288 DEBUG:teuthology.orchestra.run.trial154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T01:32:12.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T01:32:12.331 DEBUG:teuthology.orchestra.run.trial091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:12.334 DEBUG:teuthology.orchestra.run.trial126:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:12.337 DEBUG:teuthology.orchestra.run.trial154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:12.356 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern = core 2026-02-13T01:32:12.360 INFO:teuthology.orchestra.run.trial126.stdout:kernel.core_pattern = core 2026-02-13T01:32:12.378 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern = core 2026-02-13T01:32:12.397 DEBUG:teuthology.orchestra.run.trial091:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:12.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:12.432 DEBUG:teuthology.orchestra.run.trial126:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:12.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:12.449 DEBUG:teuthology.orchestra.run.trial154:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T01:32:12.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T01:32:12.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T01:32:12.481 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T01:32:12.483 DEBUG:teuthology.misc:Transferring archived files from trial091:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial091 2026-02-13T01:32:12.483 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:32:12.527 DEBUG:teuthology.misc:Transferring archived files from trial126:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial126 2026-02-13T01:32:12.527 DEBUG:teuthology.orchestra.run.trial126:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:32:12.563 DEBUG:teuthology.misc:Transferring archived files from trial154:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:09:17-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47429/remote/trial154 2026-02-13T01:32:12.564 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T01:32:12.600 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T01:32:12.601 DEBUG:teuthology.orchestra.run.trial091:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:32:12.603 DEBUG:teuthology.orchestra.run.trial126:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:32:12.606 DEBUG:teuthology.orchestra.run.trial154:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T01:32:12.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T01:32:12.671 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T01:32:12.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T01:32:12.683 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T01:32:12.683 DEBUG:teuthology.orchestra.run.trial091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:32:12.685 DEBUG:teuthology.orchestra.run.trial126:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:32:12.687 DEBUG:teuthology.orchestra.run.trial154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T01:32:12.699 INFO:teuthology.orchestra.run.trial091.stdout: 791883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:32 /home/ubuntu/cephtest 2026-02-13T01:32:12.702 INFO:teuthology.orchestra.run.trial126.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:32 /home/ubuntu/cephtest 2026-02-13T01:32:12.707 INFO:teuthology.orchestra.run.trial154.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 01:32 /home/ubuntu/cephtest 2026-02-13T01:32:12.707 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T01:32:12.719 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T01:32:12.762 INFO:teuthology.run:Summary data: description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-quota} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/kernel_untar_build}} duration: 778.5905168056488 failure_reason: '"2026-02-13T01:23:37.692740+0000 mon.a (mon.0) 415 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T01:32:12.762 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T01:32:12.873 INFO:teuthology.run:FAIL